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Abstract 


Any  real-valued  nonlinear  function  in  0*1  variables  can  be 
rewritten  as  a  multilinear  function.  We  discuss  classes  of  lower  and 
upper  bounding  linear  expressions  for  multilinear  functions  in  0-1 
variables.  For  any  multilinear  inequality  in  0-1  variables,  we  define 
an  equivalent  family  of  linear  inequalities.  This  family  contains  the 
set  of  generalized  covering  inequalities  defined  by  Granot  and  Hamer. 
Several  results  concerning  the  relative  strengths  of  inequalities  within 
this  family  are  presented.  An  algorithm  for  the  general  multilinear 
0-1  program  is  given,  and  computational  experience  with  the  algorithm 
applied  to  randomly  generated  problems  is  discussed.  The  use  of  the 
general  procedure  as  an  effective  heuristic  for  multilinear  0-1  programs 
is  also  demonstrated. 


LINEARIZING  NONLINEAR  0-1  PROGRAMS 


by 

Egon  Bales  and  Joseph  B.  Mazzola 

I.  Introduction 

It  Is  well  known  [16]  that  a  real-valued  function  f(x)  in  0-1 
variables  can  be  rewritten  as  a  multilinear  function  in  the  same  variables, 
i.e. , 


(1)  f(x)  ■  E  a  (  tt  x.),  x.  ■  0  or  l,  ie  U  Q, , 

jeN  J  i«Qj  1  *  j eN  3 

where  a^,  jeN,  are  real  numbers,  and  tt  means  product.  Thus,  without  loss  of 
generality,  when  discussing  nonlinear  0-1  programs  it  is  sufficient  to  con¬ 
sider  the  general  multilinear  program 

maximize  I  an.(  it  x  ) 

3<N0  ltQ0j 

(MLP)  E  a  (  tt  x. )  <  b.  ,  keK 

3*k  j  i6Qkj 

x  -  0  or  1,  i  «Q  -  U  Q.. 

1  keK  U  [0}  k3 

3eNk 

where  all  coefficients  are  integer.  Further,  without  loss  of  generality  we 
may  assume  that  the  objective  function  in  (ML?)  is  linear,  since  it  can  always 
be  linearized  by  introducing  a  new  (integer)  variable  z  and  amending  the 
constraint  set  K  by  one  new  constraint  involving  z  (or  its  binary  expansion) 
and  the  nonlinear  part  of  the  objective  function. 

The  subject  of  nonlinear  0-1  programming  or  0-1  polynomial  programming, 
as  it  is  sometimes  called,  has  received  a  fair  amount  of  attention  in  the 
literature  (see  for  example  [1-4,  10-16,  13,  24]).  For  a  survey  of  the  area, 

see  Hansen  [19]. 


Applications  involving  nonlinear  0>1  programming  arise  in  various 
areas.  Such  formulations  have  been  used  in  modular  design  [3],  [9],  capital 
budgeting  under  uncertainty  [21],  project  scheduling  [22],  cluster  analysis 
[23],  diagnostic  testing  [20],  media  selection  [25],  etc.  Naturally, 
quadratic  zero-one  programming  and  the  quadratic  assignment  problem  are 
also  examples  of  nonlinear  0-1  programs. 

In  this  paper  we  present  a  new  linearisation  for  nonlinear  functions 
and  inequalities  in  0-1  variables,  that  does  not  Introduce  new  variables. 

We  Chen  discuss  an  algorithm  based  on  this  approach,  and  computational 
experience  with  it. 

We  begin  by  introducing  a  family  of  linear  (and  affine)  upper  and 
lower  bounding  functions  for  the  multilinear  function  f (x) .  Several  results 
defining  classes  of  such  functions  are  stated,  and  then  properties  of  these 
classes  of  bounding  functions  are  discussed. 

In  the  next  section,  we  consider  the  multilinear  inequality 

(2)  f(x)  -  E  a  (  n  x.)  <  b, 

JcW  J  ieQj 


where  a^,  jcN,  and  b,  are  integers,  and  introduce  a  family  of  linear 
inequalities  which  is  equivalent  to  (2).  This  family  subsumes  the 
generalized  covering  inequalities  for  (2)  introduced  by  Granot  and  H 


[16].  We  Chen  investigate  properties  relating  the  strengths  of  inequalities 
within  this  family,  with  the  objective  of  obtaining  a  smaller  cardinality 
(or  more  compact)  linearization.  We  also  discuss  the  use  of  this  lineariza¬ 
tion  on  certain  classes  of  multilinear  inequalities  implied  by  (2)  in  order 


to  obtain  alternate  linearizations  of  (2).  Various  examples  illustrating 


the  fundamental  concepts  are  presented. 
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Following  this,  a  general  algorithm  for  solving  multilinear  0*1 
programs  Is  presented  In  section  three.  This  algorithm  uses  the  new  lineariza¬ 
tions  Introduced  In  section  two,  and  It  also  has  other  new  features. 
Specifically,  the  effectiveness  of  the  algorithm  is  greatly  enhanced  by 
the  Incorporation  of  a  heuristic  to  obtain  near  optimal  solutions  to  the 
0-1  linear  relaxations  at  each  iteration.  Once  a  heuristic  solution  to  the 
current  linear  relaxation  is  feasible  to  (ML),  the  algorithm  switches 
to  an  exact  solution  technique.  However,  at  that  point  the  procedure  can  be 
terminated  if  desired,  i.e.,  the  procedure  can  also  be  used  as  a  heuristic 
to  find  "good"  solutions  to  large  multilinear  0-1  programs. 

In  the  final  section,  we  present  computational  results  with  three 
different  versions  of  the  algorithm.  In  particular,  a  version  which  uses 
linear  inequalities  arising  from  the  new  Linearization  of  section  two  is 
compared  with  one  which  utilizes  only  generalized  covering  inequalities, 
like  the  procedure  of  Granot,  Granot  and  Kallberg  [15]  (see  also  [14]). 

version  stesning  from  the  direct  application  of  the  new  linearization  is 
found  to  be  superior  to  the  generalized  covering  approach  when  applied  to 
multilinear  0-1  programs  having  more  than  a  few  terms  per  constraint,  and 
the  difference  in  performance  tends  to  increase  with  the  number  of  terms. 

Thus,  our  procedure  opens  up  a  new  class  of  multilinear  0-1  programs  to 
exact  solution.  Additionally,  we  present  computational  results  concerning 
the  use  of  the  procedure  as  a  heuristic.  Typically,  the  heuristic  solutions 
obtained  were  (guaranteed  to  be)  within  37.  of  optimality,  and  for  those 
cases  in  which  the  optimal  solution  was  known,  the  heuristic  solution  was 
on  the  average  within  0.25*  of  the  optimal  integer  solution. 
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2.  Upper  and  Lower  Bounding  Affine  Functlona 
Consider  Che  multilinear  function 

(1)  f(x)  ■  E  a  (  n  x.), 

j«N  3  ieQj 

where  x  -  0  or  1,  ieQ.,JeN.  For  any  MSN,  let  Qu  »  U  Q.,  and  let  Q  -  Q„, 
i  j  M  jcM  J  N 

q  »  |Q|.  Also,  for  any  x  c  [0,l}q,  let  Q(x)  -  (icQlx^  ■  l}.  Q(x)  is  often 
referred  to  as  the  support  of  x.  A  function  g(x)  is  said  to  be  an  upper 
(lower)  bounding  function  for  f(x)  if  f(x)  <  g(x)  (f(x)  >  g(x))  for  all 

*  «  {o,i}q. 

In  what  follows,  summation  over  the  empty  sec  is  always  taken  to  yield 

zero. 

Theorem  1.  Let  f(x)  be  as  in  (1),  with  a^  >0,  jeN,  and  for  every  MSN, 
define 

(3)  g„(x)  »  Z  (ZT  a.)x.  -  Z  (|Q.|  -l)a  . 

icQjj  j«M|i*Qj  3  j«M  3  3 

Then  every  x  c  {0,l}q  satisfies  the  Inequality 

(4) m  f  (x)  >  gjjCx) 

for  every  MSN,  and  (4)  holds  with  equality  if  and  only  if 

Cl 

(5)  (j«N|QjCQ(x)}sMstjcif||Qj\Q<x)l  <  1}. 

Proof.  Let  x  c  £0 , 1  be  fixed.  For  any  MSN,  let  0^00  *  QjjfiQ(x). 

f(x)  »  — -  a  . 

jcNjQjSQCx)  3 


Then 


-5 


Thus  (7)  can  ba  raplacad  by 
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Z 

jeN* 


1  +  Yj 

J  cM+  J  J 


>  0, 


l.a.,  (4)^  holds  as  scrlce  laequallcy.il 
Remark  1.  g^x)  *  2  g^j(x). 

Proof.  By  applying  the  definition  of  g^Cx)  to  C j  J  for  «a<=h  j  «M.  jj 
Remark  2.  For  every  x  c  {0,i}^,  there  exists  some  M£N  such  chat 
f(x)  -  Sn^- 

Proof.  Set  M  ■  [j«N|<5.  £Q(x)].  Then  x  and  M  satisfy  (5),  hence 

f(x)  -  Sg00*ll 

A  set  9  of  lower  (upper)  bounding  functions  p(x)  for  f(x)  will  be 
called  complete  if  for  every  x  e  {0,l}^  there  exists  p  e  9  such  that  p(x)  *  f(x). 
From  Remark  2,  the  set  s£  ■  [g^(x)|M£N}  is  complete.  Since  £  is  fairly 
large  (|sd|  *  2^),  it  is  of  interest  to  find  proper  subsets  of  sd  that  are 
complete.  Next  we  identify  oae  such  subset. 

For  any  MSN,  define 

Et(M)  -  Cj«n||Q  \Qjjt  -  i},  i  -  l,...,p, 

where 

p  -  maxC|Q.\QM|}. 
jcN  1 


Clearly,  MCEq(M)  for  any  MSN.  Further,  denote 
E(M)  -  Eq(M)  UB1(M)  , 


and  note  that  for  arbitrary  subsets  M^,  MjSN,  j4  does  not  imply 
E(M^)  *  E(M2). 


Consider  now  Che  family 


^0  * 

of  lower  bounding  functions  for  f(x),  whose  cardinality  is  typically  much 
smeller  than  that  of  £. 

Theorem  2.  Let  f(x)  be  as  in  (1),  with  a^  >  0,  jeN.  Then  j£q  is  a  complete 
set  of  lower  bounding  functions  for  f(x). 

Proof.  For  a  given  x  e  £0,1}^,  define  L  -  £j «n|Q^  S  Q(x)}.  Then 
8E(L)  6  s^o*  aad  *«tting  M  •  E(L)  in  (5)  shows  that  f(x)  ■  8e(L)^*  Siaca 
this  is  true  for  every  x  e  {0,l}q,  is  complete.|| 

Remark  3.  For  every  MSN,  there  exists  some  x  e  (0,1}**  such  that 

f(x)  *  «E(M)(X)- 

Proof.  For  given  MSN,  let  x  be  defined  by  Q(x)  »  U  Q  Then 

jeM  J 

£ j  | Q ^  SQ(x)}  SE(M)  S  £ j CN |  |Qj\Q(x)  l  <  1}, 

and  hence,  from  Theorem  1,  f(x)  »  ®e(m)^*M 

Note  that,  while  every  lower  bounding  function  in  is  "attained"  by 
f(x)  for  some  x  *  {0,l}^,  the  same  is  not  true  in  general  with  respect  to 
the  larger  family  £.  Thus,  let 

f  (x)  =*  x^x.^  +  x^Xj  +  x^  +  x1x5  +  x2x5  +  x3x4, 

and  choose  M  »  £1,2} ,  where  Qt  *  Cl, 2,3},  Q2  *  (4,5}.  Then  the  lower  bounding 
function 

’  *1  +  *2  +  *3  +  *4  +  *5  ‘  3 
is  doc  oqual  Co  f(x)  for  tny  z  «  (0, l]3 . 
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Naxt  we  illustrate  the  families  £  and  ^  oa  an  example. 
Example  1.  Let 


f(x)  »  3x^Xj*2  +  +  x2x3x4* 

Then 


g{1.2. 3) 
*(1,2) 
®!2,3} 
*U,3} 
*C1) 

*12} 

*C3} 

*» 


■  5x^  +  4x^  +  4xj  +  3x^ 

■  5x^  +  3x^  +  3x^  +  2x^ 

■  2x^  +  x2  +  x3  +  ^x4 

*  3x^  +  4x^  +  4x^  + 

*  3x^  +  3X2  +  3x^ 

*  2x.  +  2x, 


x2  +  x3  +  x4 


10 

8 

4 

8 

6 

2 

2 

0 


A  complete  system  of  lower  bounding  functions  consists  of 
^0  *  k(l,2,3}»  8 {2}'  80^' 

since  for  all  MC  (1,2,3},  M  f  (2},  0,  we  have  E(M)  »  (l,2,3}.|| 

Next  we  turn  to  upper  bounding  linear  functions  for  f(x).  Let  tp 
be  a  mapping  that  associates  to  every  Q^,  jeN,  some  ieQ^,  i.e.,  <p(Q^)  *  i(j)«Qj, 
and  let  i  be  the  sec  of  all  such  mappings. 

Theorem  3.  Let  f(x)  be  as  in  (1),  with  a^  >  0,  jeN.  For  ipil,  define 

V*> '  Vkj)' 

where  i(j)  *  ®(Qj).  Then  every  x  e  (0,l}^  satisfies  the  inequality 
(8)0  f  (x)  <  h  (x) 


for  every  ® e I,  and  (8)^  holds  as  equality  if  and  only  if 
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(9)  i(j)eQj\Q(x) 

for  all  jeN  such  that  Qj\Q(x)  t  0. 

Proof.  For  a  given  xe  {0 , 1 J*1 »  define  M  *  [j  cN  |  Q  ^  SQ(x)  J.  Then  for 
every  cp  e  4 , 

(10)  f (x)  *  £  a  (by  the  choice  of  M) 

jeM  J 

*  Z  a  x  (where  i(j)  =  p(Q  )) 

jeM  J  i 

<  S  ai*tm  *  h  (x)  (since  a  >  0,  jeN), 

jeN  ]  UJ  v  J 

i.e.,  (8)  is  satisfied. 

9 

If  i(j)  eQj\Q(x)  for  all  jeN  such  that  Q^\Q(x)  t  0,  then  x^  j  *  0, 

9  jeN\M,  and  the  inequality  in  (10),  hence  in  (8)^,  holds  as  equality. 

Conversely,  if  i(j)  eQ.fiQ(x)  for  some  j eN\M,  then  x.  ...  *  1  and  (8)  holds 

j  i(j)  9 

as  strict  inequality,  since  a^  >  0,  jeN.  Since  this  argument  applies  to 

every  x  e  [0,1}^,  the  proof  is  complete. || 

Remark  4.  If  f(x)  is  as  in  (!)  but  with  a^  <0,  jeN,  then  for  every 

Pei,  hffl(x)  is  a  lower  bounding  linear  function  for  f(x). 

Proof.  Applying  Theorem  3  to  -f(x)  yields  -f(x)  <  -h  (x) ,  ¥  pc4.ll 

“*  9 

Remark  5.  For  every  pei  there  exists  some  x  e  {0,1}^  for  which 

f(x)  »  h  (x). 

9 

Proof.  Both  x  *  0  and  x  «  e,  where  e  *  (1 . 1) ,  produce  equality 

in  (8)_  for  all  cp  <  4. 

V 

Remark  6.  For  every  x  e  (0,l}^,  there  exists  some  oei  such  that 
f(x)  «  hffl(x). 

Proof.  Use  any  mapping  satisfying  p(Q^)  sQ^\Q(x)  for  all  jeN  such 
that  Qj\Q(x)  t  0;  then  (8)^  holds  as  equality. j| 
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Thus  Che  family 

U  ■  th^Cx)!?*  5} 


of  upper  bounding  functions  for  f(x)  is  complete  in  Che  above  defined  sense. 

There  is  actually  a  more  general  class  of  upper  bounding  linear  functions 
for  f(x),  namely 

Remark  7.  Let  X^,  ieQ,  jeN  be  nonnegative  numbers  satisfying 


(ID 


Z  X 
i«Qj 


ji 


1, 


and  define 


jeN, 


h(X,x)  »  Z  a  (  Z  X..x.). 
j«N  2  isQj  1 

Then  every  x  e  {0,1}^  satisfies  the  inequality 
f (x)  <  h(X,x) 

for  every  X  >  0  satisfying  (11) . 

Proof.  For  any  x,  define  Q(x)  as  before;  then 

f(x)  *  a 

jeN|QjCQ(x)  2 

and 

h(X,x)  *  Z  a  (21  X..) 

jcN  -1  i«Qj  flQ(x)  2 


-*==•.(  Z  X  i  +-£T~7—. . a/x -  A  ' 

J«U|Q  CQ(x)  2  icQ  21  j«NiQj^Q(x)  2  i«Q  fiQ(x)  J1 

>  ^  ...  ■  ~  a  -  f(x).'|| 

jeN|QjCQ(x)  2 

The  family  V,  introduced  earlier  consists  of  those  h(X,x)  such  that 
fl  for  i  -  i(j) 

Si  I 

2  [o  for  i  i  i(j). 
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Since  the  set  U  is  complete  and  already  very  large  (not  excluding 

repetitions,  ■  rr  )Q  |),  we  will  not  consider  further  the  more  general 
jcN  J 

class  of  functions  defined  in  Remark  7,  but  rather  move  in  the  opposite 
direction  of  identifying  a  proper  subset  of  Z(  that  is  complete. 

For  any  cpe$,  define 

1(9)  *  {ieQji  51  sp(Qj)  for  some  jeN}. 

We  will  say  that  a  mapping  cp  e  <1  is  sequence-related  if  there  exists  a 

permutation  <  i- >  of  the  elements  of  I(cp),  with  the  property  that  for 
1  m 

*  <p(Qj)  for  all  j  eN  such  that  i^  s  Q ^  but  i^  i  for  t  »  1, . . .  ,k- 

We  will  say  that  s_  *  <  i, . i  >  is  the  sequence  associated  with  the 

cp  I’  ’  m  - ■ - 

mapping  To  put  it  differently,  a  mapping  o  s  i  is  sequence- re  la  ted  if  it 

can  be  generated  as  follows:  choose  some  i  sQ  and  set  i  *  cp(Q^)  for  all 

j  £N  such  that  i  e  ;  then  remove  from  Q  all  subsets  containing  i,  and 

apply  the  procedure  to  the  redefined  set  Q,  stopping  when  Q  becomes  empty. 

Example  2.  Let  *  {1,2,3},  =  {1,4,5},  =  {2,5}.  Then  each  of 

the  mappings 


w 

- 1, 

W 

«  1, 

<px(q3)  -  2 

W 

- 1, 

w 

*  5, 

«P2(Q3)  *  5 

W 

-  1, 

W 

-  4, 

=P3(Q3)  =  2 

is  sequence-related,  with  the  associated  sequences  {1,2},  {5,1}  and  {4,1,2} 
respectively;  but  the  mapping 

vv  *  W  38  3>  W  m  2 

is  not  sequence-related,  since  for  any  permutation  of  the  indices  1,5,2,  the 
first  index  does  not  represent  all  sets  in  which  it  is  contained  (1  is 
contained  in  and  Q2,  5  in  and  Q^,  2  in  and  Q3).!| 


k  *  1* • • • >  \ 
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Lat  5/  »  [<pe$|<p  is  sequence-related},  and 


It  can  be  shown  (see  below)  that  V.'  is  a  complete  set  of  upper  bounding 
functions  for  f(x).  However,  it  turns  out  that  §'  can  be  further  restricted 
without  losing  completeness. 

Let  V  be  an  arbitrary  set  with  \v\  »  v,  and  let  9  be  the  set  of  all 
permutations  of  the  elements  of  V.  For  any  SC7,  a  permutation  pe^  will  be 
said  to  represent  in  9  the  2-partition  (S,  V\S)  of  V,  if  every  element  of  S 
precedes  every  element  of  V\S  in  p.  In  other  words,  the  permutation 
p  »  <i1,...,iv>  represents  the  partition  (S,  V\S)  if  i  e  S  and  i^  e  V\S 
imply  k  <  l.  A  set  of  permutations  PC0  will  be  called  representative  (of 
che  2-partitiona  of  V),  if  for  every  SC7,  the  partition  (S,  V\S)  is 


represented  in  P . 

Example  3.  Representative  secs  of  permutations  for  V  *  [1,2,3}  and 
v2  "  U>2»3,4}  are  Pj^  and  ?2, 


13* 

2  3* 

3  *  * 


12  4* 

13  4* 
2  3  4  * 
14** 

2  4** 

3  4** 

4  *  *  * 


where  a  star  in  some  p  e  P^  stands  for  an  arbitrary  element  of  V  not  yet 
used  in  p.jj 
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While  Che  cardinality  of  ^  is  v!,  chat  of  a  representative  subset 

v-l 

PC#  is  only  2 

Consider  now  the  set  of  sequence-related  mappings  For  any  S  CQ, 

we  say  that  a  mapping  cpci',  with  associated  sequence  *  <  i^,#..fia  >  , 
represents  the  2-partition  (S,  Q\s),  if  is  a  subsequence  of  some  permuta¬ 
tion  p  *  <  >  of  the  elements  of  Q,  that  represents  (S,  Q\S) .  A 

set  of  sequence-related  mappings  will  be  called  representative  (of  the 

2-partitions  of  Q)  if  every  2-partition  of  Q  is  represented  in  T . 

Now  let  be  representative,  and  define 

-  £h<p(x)|q3«’r}. 

Theorem  4.  Let  f(x)  be  as  in  (1),  with  a^  >  0,  j«N.  Then  a  complete 

set  of  upper  bounding  functions  for  f(x). 

Proof.  For  an  arbitrary  x  e  £o,l}^  let  g  e  Y  be  the  mapping  that 
represents  the  partition  (Q\Q(x),  Q(x))  of  Q  (here,  as  before, 

Q(x)  *  £j  eQl^j  *  l}),  leC  "  <  H’***'^  >  be  Cfae  se<?uence  associated 
with  g,  and  let  p  *  <  >be  a  permutation  of  the  elements  of  Q  that 

represents  (Q\Q(x),  Q(x)),  such  chat  s„  is  a  subsequence  of  p. 

Now  if  i  eQ\Q(x),  then  i.  sQ\Q(x)  for  K>  ■  l,...,m,  and  h,(x)  »  0  ■  f(x). 
Otherwise,  let  h  and  k,  respectively,  be  the  greatest  integers  such  that 
i^aQVHx)  and  jfe  eQ\Q(x).  Then  Q\Q(x)  »  tjj_»  •  •  • » Jk}>  and  £i-1  >  •  •  •  ,1^}  £Q\Q(x) , 
£ih+1,...,im}fiQ(x).  Denote 

NQ  -  {j  «Nlcp(QJ)c£l1, . . .  ,1^}}  , 

»!  ■  . i»}}  . 
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Clearly,  NgUN^  *  N.  Since  <p  is  relaced  to  Che  sequence  s^,  i^  i 

for  4c  [l,...,h}  and  jeN^,  hence  Q^CQ(x)  for  all  jeN^.  Therefore  Qj\Q(x)  *  0 

implies  j  *Nq»  which  in  turn  implies  «P(Q^)  eQ\Q(x);  i.e.,  condition  (9)  of 

Theorem  3  holds  for  all  jeN  such  that  Q.\Q(x)  #  0.  Therefore  f(x)  -  h  (x).j| 

J  <9 

Example  4.  As  in  example  1,  let 

f(x)  ■  Sx^x^x^  +  ^xix4  +  x2x3x4‘ 

The  set  §  of  all  mappings  that  associate  to  each  of  the  sets  Q  ^ ,  j  -  1, 
one  of  its  elements,  contains  [QjJ  X  X  (Q^l  *  18  elements,  and  the 

corresponding  18  upper  bounding  functions  h^Cx),  happen  to  be  pairwise 

distinct.  However,  a  complete  set  of  upper  bounding  functions  is  defined 
by  Che  representative  sec  of  sequence-related  mappings  associated  with  the 
set  Example  2  (where  Q  *  (1,2,3, 4}  plays  the  role  of  V,): 


h  (x) 
*1 

a 

5x^  +  x2 

h«  <x> 
*2 

a 

5x^  +  x^ 

h  (x) 
*3 

m 

5X1 

+ 

X 

i 

h«  <x> 
*4 

a 

4*2 

4* 

*x, 

h  (x) 
*5 

M 

4x^ 

+ 

2x 

< 

h  (x) 

a 

3x3 

4- 

3x 

i 

The  mappings  a,  k  ■  1,...,6,  correspond  to  the  following 


permutations  peP2: 
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Where  a  napping  corresponds  Co  more  chan  one  p  cP ^  as  for  k  »  1,4, 

this  Is  because  different  permutations  containing  a  certain  subsequence 

<  i- . i  >  give  rise  to  a  single  mapping  <?  e ?  related  to  that  subsequence. 

in 

Thus,  ia  th«  esse  of  k  *  1,  *  <  1,2  >,  and  in  the  case  of  k  ■  4,  s^  «  <  2,4  >. 

cp  cp 

Ac  this  point  we  mention  that  there  is  another  class  of  upper  bounding 
(affine)  functions  for  f(x),  that  one  can  derive  by  using  the  following 
observation. 

Let  Q  be  a  set  whose  elements  are  ordered  in  some  arbitrary  way, 

Q  »  [lf...,q},  and  let  a  be  an  arbitrary  positive  scalar.  Then,  denoting 
x^  *  1  -  x^  for  icQ,  one  can  write 

-  q-1  q-2  _ 

(12)  -a  rr  x  -  a(x  tt  x.  +  x  -  tt  x.  +  ...  +  x-x.  +  x,  -  1). 

ieQ  1  q  i-1  1  q_1  i-1  1  ^11 

Note  that  the  right  hand  side  of  (12)  has  q  *  |q|  variable  terms  (each 
one  containing  exactly  one  complemented  variable)  and  a  constant  term. 

Thus  for  any  f(x)  of  the  form  (1)  with  a^  >  0,  jcN,  using  (12)  one  can 

write 

-f(x)  »  p  (x,x), 

where  is  a  multlliaear  function  of  the  variables  x^  and  their  complements 

x^,  ieQ^,  j sN,  with  coefficients  a^  >  0  and  with  |Q^|  terms  for  each  jcN. 

The  subscript  or  refers  to  Che  particular  ordering  of  the  secs  Q^,  jeN,  which 

was  used  in  (12)  to  derive  p  (x,x).  Taking  any  and  applying  Theorem  1, 

or 

one  can  derive  a  family  of  lower  bounding  functions  g^(x,x)  for  p^(x,x) , 

one  for  each  sec  of  the  form  M  »  U  M,,  where  M, cQ  ,  jeN.  Substituting 

j  cN  J  1  1 

for  i«Qj,  j«N,  one  obtains  the  corresponding  functions  8jj(x)  (■  g^Cx.x) ) 
in  the  variables  x^,  and  by  changing  signs,  the  affine  upper  bounding  functions 
-  g^(x)  for  f(x). 
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For  a  given  f(x)  of  che  fora  (1),  there  ere  tt  (|Q  (!)  different  func- 

jeN  lQll 

tlone  p  (x,x)  such  that  p  (x,x)  *  -  f(x),  and  for  each  a,  there  are  n  2 1  J ' 

®  a  j  cN 

lower  bounding  functions  g^(x,x)  (not  necessarily  all  distinct)  for  p^(x,x), 

hence  upper  bounding  functions  -  g^(x)  for  f(x).  However,  as  stated  in  the 

next  theorem,  every  such  upper  bounding  affine  function  is  dominated  by  some 

linear  function  in  the  class  !<• 


To  simplify  the  notation,  we  will  assume  that  f(x)  has  a  single  term, 
i.e.,  the  equation  -  f(x)  ■  p^(x,x)  is  as  in  (12).  In  view  of  Remark  1,  this 
implies  no  loss  of  generality.  Further,  we  shall  let  each  of  the  |Q|  *  q 
terms  of  p^(x,x)  be  indexed  by  che  index  of  its  (unique)  complemented  variable. 
Theorem  5.  Let  MCQ,  M  •  . i^},  with  i^  <  i^  whenever  k  <  L.  Then 


**1  i  -  «M(x> 

a 

for  every  x  c  (0,1}*. 

Proof.  Applying  Theorem  1  to  p^(x,x),  we  obtain  che  lower  bounding 
function 


gM(x,x)  -  at  £  (x  +  Z  x  -  (i  -  D)  -  1) 

k-1  Sc  i-l  1  K 

or 

m  Sc~^ 

gv.(x)  -  -  a(  £  (x  -  £  x.  +  1.  -  2)  +  1] . 

^  k-1  St  i-l  1  ^ 


Therefore 


-gM(x)  -  axt  +  a  ar  (x) 
m 


where 


i  -l  .  Sc‘l 

a  a- 1  rv 

a(x)  -  (1  -  l  -  Z  x.)  +  Z  (i.  -  2  +  x,  ’  V’ 
i-l  1  k-1  * 


Sc 


i«l 


(13) 
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an d  to  prove  the  theorem  we  have  to  show  that  a(x)  >  0  for  all  x  c  (0,l}q. 
Note  that  for  k  »  l#...,m  -  l. 


Sc 


2  +  x 


Sc 


Sc  1  f  *  -l  if  x  ■  1,  t*l,...,i^-l,  and  x.  *  0 

^  xi  ^ 

1*1  >  0  othervise 


and 


Since  x  ■  0  for  some  kg(lf _ ,1^  -  1}  excludes  z.  *  1,  1*1,..  .  -  1 

tC 

for  any  t  >  k,  at  most  one  term  under  the  sunmation  sign  in  (13)  can  be  negative, 
and  if  there  exists  such  a  term,  then 

i  -1 
m 

i  -  1  -  Z  x,  >  1. 

°  t-i  1 


Thus  for  any  x  e  (0,l}q,  <j(x)  >  0,  hence  -  g^( x )  >  ax^  ,|| 

m 

The  relation  (12)  can  be  used  in  the  reverse  direction  too;  i.e.,  in 
order  to  derive  a  set  of  lower  bounding  functions  for  some  f(x)  as  in  (1) , 
with  Sj  >  0,  jcN,  one  can  use  Theorem  3  to  derive  a  set  of  upper  bounding 
linear  functions  h  (x,x)  for  p  (x,x)  *  -  f(x),  and  then  substitute  for  x  ,  ¥>  i, 
to  obtain  a  set  of  functions  6^(x) ,  whose  negatives,  -  5^(x) ,  are  lower 
bounding  functions  for  f(x).  In  this  case  one  recovers  the  lower  bounding 
function  g^(x),  by  using  the  mapping  ?  which  associates  to  the  index  set  of 
each  term  of  p^(x,x),  the  index  of  its  complemented  variable.  The  functions 
gM(x),  M^N,  can  be  recovered  by  using  Che  same  mapping  for  j«M,  while  for 
j«N\M  one  uses  a  mapping  that  produces  a  lower  bounding  function  identically 
equal  co  zero.  Whan  Che  number  of  eeras  of  p^(x,x)  corresponding  co  the  j 


-18- 


carm  of  f(x)  is  even,  this  is  accomplished  by  any  mapping  chat  produces 
pairwise  complementary  images.  When  it  is  odd,  one  has  to  use  the  construc¬ 
tion  of  Remark  7  to  find  a  lower  bounding  function  that  vanishes  for  all 
x  «  C0,l}q. 

All  ocher  lower  bounding  functions  chat  one  obtains  via  this  procedure 
are  uninteresting,  because  they  cannot  cake  on  a  positive  value  for  any 
x  c  (0,l}q. 

We  conclude  this  section  by  combining  the  above  results  to  derive  a 
family  of  lower  bounding  functions  for  f(x)  as  in  (1),  with  coefficients  a^ 
of  arbitrary  sign.  Let 


and 


N+  -  tj«N|a^  >  0} 

f*(x)  -  Z  a  n  x 
jctf*  3  icQj 

For  every  MCH+,  let 


N"  -  (jsNIaj  <  0}, 


f"(x)  *  £  a  n  x  . 

j  eN"  J . 


gM(x)  -  Z  a  )x,  -  Z  ( |Q.  |  -  l)a 

i«QM  JcMjicQ  J  1  jcM  3  3 

as  in  Theorem  1.  Let  i~  be  the  family  of  mappings  <?  that  associate  to  every 
Qj*  j«N”,  some  *Qj»  and  for  every  «pc$”,  let 


hffl(x) 

9 


jcM' 


where  i(j)  ■  <p(Q,)>  j«N~.  The  function  h”(x)  differs  from  the  function  h  (x) 
J  «P  50 

of  Theorem  3  only  in  that  here  the  coefficients  a^  are  negative. 

Theorem  6.  Let  f(x)  be  as  in  (1).  Then  every  x  «(0,l}q  satisfies 


f(x>  £  *M<X>  +  hi(x) 


1 
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for  every  MfiS+  and  every  tp«3”.  Further,  (14)^  ^  holds  as  equality  If 
and  only  If 

(15)  UcN+lQjCQ(x)}CHC{je»f||Qj\Q(x)|  <  1} 

and  for  all  jsN*  such  that  Q^\Q(x)  j*  0, 

(16)  l(j)«Qj\Q(x) 

Proof.  Since  N+UN”  ■  N,  we  have 

f(x)  -  f+(x)  +  f"(x) ; 

From  Theorem  1,  for  every  MCS+ 

(17)  **(*>  >85,00; 

and  from  Theorem  3,  for  every  ;p  e  3* 

(18)  f'(x)  >  h"(x). 

<p 

Then  adding  (17)  and  (18)  yields  (14). 

Now  (17)  holds  as  equality  If  and  only  If  (15)  is  satisfied  (Theorem  1), 
while  (18)  holds  as  equality  if  and  only  if  (16)  is  satisfied  for  all  jcN~ 
such  that  Qj\Q(x)  i*  0.  (Theorem  3).  But  a  vector  x  c  {0,1}^  that  satisfies 
both  (17)  and  (18),  satisfies  (14)M  with  equality  if  and  only  if  it 

satisfies  with  equality  both  (17)  and  (18). || 

Next  we  define  a  subfamily  of  the  lower  bounding  functions  introduced 
in  Theorem  6,  that  is  complete. 

For  every  MCN+,  let  E(M)  be  defined  as  in  Theorem  2,  and  let 

*  ^®E(M) 
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Further,  let  Y*cJ"  be  a  representative  set  of  sequence-related 
mappings  as  defined  earlier,  and  let 

Finally,  define  ehe  sec 

3q  *  +  h"(x)|MCN+  and  ?ef}. 

Theorem  7.  3 ^  Is  a  complete  set  of  lower  bounding  functions  for  f(x). 

Proof.  Since  ^  and  1<q  are  complete,  for  every  x  e  [0,1}^  there  exists 
some  gE(M)(*)  such  that  f+(x)  -  gg^Cx),  and  some  h*(x)€*K"  such  that 
f“(x)  »  tT(x).  But  then  g£(M)(x)  +  h“(x)  c£Q  and  f(x)  -  g^^Cx)  + 
hence  3°  is  complete. || 

Example  5.  Consider  the  function 

f(x)  *  dx^x^Xj  “  2x^2  +  Sx^x^x^  -  x^x^  +•  ^x^x^ . 

The  set  ^  of  lower  bounding  functions  for  f+(x)  is 

8x^  +  12xj  +  13Xj  +  4x^  +  5xj  +  5xg  -  30, 

8x^  +  12x^  +  8Xj  +  4x^  -  20, 

5Xj  +  5xj  +  5Xg  -  10, 

4*2  +  -  4» 

0; 

while  the  set  2/”  of  lower  boundiag  functions  for  f“(x)  is 

—  2x^  —  X2 , 

-  2x^  -  Xj, 

-  3x2* 

Hence  a  complete  set  3^  of  lower  bounding  functions  for  f(x)  consists  of 

the  IS  functions  obtained  by  adding  any  of  the  5  functions  in  sdg  to  any  of 

the  3  functions  in  ^Q.jj 
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3,  Linearizing  Multilinear  Inequalities  In  0-1  Variables 

In  this  section  we  linearize  the  multilinear  inequality 

(2)  f(x)  -  £  a  (  it  x  )  <  b 

jeN  2  ieQj  1 

by  defining  a  family  S*  of  linear  inequalities,  equivalent  to  (2)  in  the  sense 
that  a  0-1  vector  x  satisfies  f(x)  <  b  if  and  only  if  it  satisfies  the  linear 
inequalities  in?.  This  family  is  shown  to  contain  the  family  of  generalized 
covering  inequalities  defined  by  Granot  and  Hatnner  [16].  We  then  present 
several  results  which  relate  the  strengths  of  inequalities  in?,  and  which 
are  useful  for  obtaining  a  smaller  family  of  linear  inequalities  equivalent 
to  (2).  We  first  give  some  definitions. 

An  inequality  A  is  said  to  dominate  an  inequality  B  if  every  nonnegative 
x  satisfying  A  also  satisfies  B.  Further,  inequality  A  strictly  dominates 
inequality  B  if  in  addition  to  A  dominating  B,  there  exists  some  point  x 
such  that  x  satisfies  B  but  not  A.  We  shall  also  find  it  useful  to  define 
the  following  weaker  notion  of  dominance. 

An  inequality  A  is  said  to  c-dominate  an  inequality  B  if  every  0-1 
point  x  satisfying  A  also  satisfies  B.  Further,  if  A  c-dominates  B  and 
there  exists  some  0-1  point  satisfying  B  but  not  A,  then  A  is  said  to  strictly 
c-dominate  B.  It  is  easily  verified  that  an  inequality  A  can  c-domiaate 
an  inequality  B  without  A  dominating  B. 

We  continue  to  use  the  notation  introduced  earlier.  In  particular, 

N+,  N  ,  f+ (x)  and  f  (x)  are  as  in  Theorem  6. 

A  set  MSN  is  said  to  be  a  cover  for  the  inequality  (2),  if 

Z  ja  I  >b  -  Z  a 
jeM  2  j  eiT  2 
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A  cover  M  is  said  Co  be  m^nima^,  if  X  is  aot  a  cover  for  any  T  ^  M. 

It  follows  from  this  definition  that  a  set  MSN+  is  a  cover  for  the 
Inequality 

(2+)  f+(x)  <  b 

if 

I  a  >  b. 
jeM  J 

Theorem  8.  Let 

»  [MCN+|M  is  a  cover  for  (2+)}, 

and  let  g^C*),  h’(x)  and  be  as  in  Theorem  6.  Then  xc  (O.l}^  satisfies  (2) 
if  and  only  if  it  satisfies 

(19) M,?  *mW  +  h‘(x)  <  b 

for  every  M  «  C-  and  «?  «  $  . 

Proof,  From  Theorem  6,  if  x  e  [0,l}^  satisfies  (2),  then 
gjjC*)  +  h^(x)  <  f(x)  <  b 

for  every  9  e  5  and  every  MSN+,  hence  every  MeC-.  This  proves  the  "only  if" 
part  of  the  Theorem.  To  prove  the  "if"  part,  suppose  f(x)  >  b  for  some 
it  [0,l}^.  From  Theorem  7,  there  exists  and  cp^  «  §"  such  that 

(20)  gy  (x)  +  h"  (x)  »  f(x)  >  b, 

n0 

i.e.,  x  violates  the  inequality  (19).,  „  .  It  remains  to  be  shown  that  M„ 

+  V’o  * 

is  a  cover  for  (2  ) .  We  have 
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Examole  6.  Consider  che  inequality  (2)  with  f(x)  as  in  Example  S 
and  b  »  8 ,  i . e . , 

8x^x2x3  +  ^x2x4  +  ^X3X5X6  "  2xjX,  ~  X?X5  —  8. 


Denoting  QJ>  -  (1,2,3},  Q2  =  (2,4},  Q3  =  (3,5,6},  -  (1,2},  Q5  =  (2,5}, 

the  subsets  of  N+  »  {1,2,3}  that  are  covers  for  (2+)  are  -  (l,2},  M,  =  (1,3}, 
M3  -  (2,3},  M4  -  (1,2,3}.  They  correspond  to  the  functions 

g^(x)  *  8x^  +  12x^  +  8x3  +  4x4  -  20 

g^  (x)  =  8x^  +  8x^  +  13x3  +  5x3  +  5x^  -  26 

g^  (x)  »  4x^  +  5x3  +  4x4  +  5x3  +  5Xg  -  14 


gjj  (x)  -  8x^  +  12x2  +  13x3  +  4x4  +  5x5  +  ,„6 


5x,  -  30. 


Further,  the  set  consists  of  the  mappings  tp^,  qj? ,  sp3>  a^,  giving 
rise  to  the  4  functions 


h  (x) 

V 


h_  (x) 


<P, 


2X1  ‘  x2 


2*1  "  *5 


h'  (x)  -  -  3x, 
2 


h  (x) 


-2x2  -  x.. 


Thus  the  system  $  equivalent  to  (2)  consists  of  the  16  linear  inequalities 
8^00  +  h*  (x)  <  8,  i-  1,2, 3, 4;  j-  1,2, 3, 4 

However,  since  »  (cp^,  q>3}  and  EO^)  «  (1,2}(-  M^) ,  EO^)  *  E(Mj)  * 

E(M4)  »  (l,2,3}0  M^),  the  smaller  system  equivalent  to  (2)  consists  of  the  6 


Inequalities 
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ex^  +  llx^  t  8x^  +  4x^  <  28 

6x^  +  12xj  +■  8x^  +  4x^  -  Xg  <  28 

8x-  +  9x  +  8x.  +  4x.  <  28 

1  2  3  4  — 

6x^  +  llx^  +  +  4x^  +  5xg  +  5xg  <  38 

6x^  +  12x^  +  13x^  +  4x^  +  4xj  +  5x^  <  38 

8x^  +  9x^  +  13x^  +  4x^  +  5xg  +  5x^  <  38. || 

Ic  is  sometimes  useful  to  consider  instead  of  the  nonlinear  inequality 
(2),  an  equivalent  system  of  (nonlinear)  inequalities  whose  coefficients  are 
all  positive.  This  is  easily  accomplished  by  replacing  f  (x)  in  (2)  with 
the  family  of  lower  bounding  functions  h”(x),  gef  ,  and  then  complementing 
xj,  jeN". 

Theorem  10.  A  vector  x  e  (0,l}^  satisfies  (2)  if  and  only  if  it  satisfies 

(22)  f+(x)  +  Z  (a  lx  <  b  -  Z  a 

¥  j€N-  J  ^K2)  j  cNT  2 

where  i(j)  *  cpCQ^),  f°r  ever? 

Proof.  The  "only  if,f  part  follows  from  the  fact  that 

(23)  Z 

j  cN~  2 

for  all  i(j)  *  ®(Qj),  9  €  .  The  f,ifM  part  follows  from  the  fact  that  the 

set  of  lower  bounding  functions  h^(x)  ,  ,  for  f  (x) ,  is  complete;  hence 

if  for  some  x  s  [0,l}^ 

f(x)  =»  f+(x)  +  f“(x)  >  b, 

then  there  exists  ^  c  Y  such  that,  putting  i(j)  *  Og(Qj), 

2  aAm  3  >  b  •  f+(x), 

j  eN“  2 

i.e.,  x  violates  (22)  .\\ 
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Remark  8.  Theorem  10  remains  erue  if  'f  is  replaced  by  5” . 

Proof.  Since  f'cS  ,  the  "if1'  part  is  obviously  true;  the  "only  if" 
part  follows  from  the  fact  that  (23)  holds  for 

Note  that  if  we  first  replace  (2)  by  the  family  (22)  ,  cp  e and  then 
generate  the  sets  of  linear  inequalities  equivalent  to  each  inequality  (22)^, 
we  end  up  with  a  set  *  U  S  of  linear  inequalities  that  is  a  proper 
superset  of  the  one  obtained  when  we  generate  the  set  S  directly  from  (2). 

The  reason  for  this  is  that,  applying  Theorem  8  to  an  inequality  (22)^,  we 

will  generate  a  linear  inequality  for  every  cover  MCN  for  (22)  ,  hence  for 

y 

(2);  whereas  applying  it  to  the  inequality  (2),  we  generate  linear  inequalities 
only  for  covers  MCN+  for  (2+).  It  is  easy  to  see  that  if  M^CN  and  M^CN 
are  covers  for  (2),  we  may  have  but  M^ON  *  ^  flN+.  On  the  other 

hand,  M»N+  is  a  cover  for  (2)  if  and  only  if  MUN  is  a  cover  for  (22)  , 

y 

V  cp  e  3  ,  Thus  the  system  of  linear  inequalities  S,  obtained  by  applying 
Theorem  8  directly  to  (2),  is  that  subsystem  of  whose  inequalities 
correspond  to  those  covers  MCN  such  that  N"  CM, 

Next  we  turn  to  another  way  of  using  complements  of  the  variables. 

If  we  restate  the  system  (19)  by  complementing  the  variables  x^,  i  e  Q^,  this 
operation  can  be  combined  with  a  (trivial)  strengthening  of  some  inequalities. 
For  any  cp  e  $  ,  we  will  denote 

*  [i  e  Q|  i  *  i(j)  for  some  j  cfrT}, 
where,  as  before,  i(j)  »  cp(Q  )  # 

Theorem  11.  The  vector  x  e  {0,1}^  satisfies  (2)  if  and  only  if  it  satisfies 


(24) 


M  - 


M,c? 


a 


icQ. 


i  i 


M 


Z 

^cQ 


3ixi 


-  °0 


'CD 


for  every  M  sO,  mci",  where 


M 

*o 


2  a,  -  b, 

jsM  J 


t 


M  .  f  M  ^ - , 

a  =*  niQ[or  .>  -  «  }  , 

jeMluQj  J 


1  <QM* 


@  -  minCa0,  •*-  laj l }» 

j  eN” | i*i  ( j )  J 


Proof.  Substituting  for  g^(x)  and  h^x)  in  (19)^  ^  their  expressions 


in  terms  of  the  coefficients  a^,  jeN,  yields 


(19  \ 


ieQM  jeMjisQj 


i  )x  +  2  ax  <  b  +  Z  (|Q. I  -  l)a 

J  1  j cN  J  jeM  J  J 


where  i(j)  »  cp(Qj ) ,  jeN",  as  before.  Substituting  1  -  xt  for  x.,  i  e  QM> 
and  -  [a^|  for  a^ ,  jeN  ,  and  collecting  terms  for  each  i  e  Q^,  then  changing 
the  sign  of  the  inequality,  produces 

(25)  Z  (Z==  a  )x.  +  E  (<>..  ,  U4|)x.  >  Z  a.  -  b. 


i6QM  j  eM|  ieQj 


)x  +  E  U -  lal  *  >*i  —  1  a4  "  b» 

J  1  isQ  jeN~[i*i(j)  J  jeM  J 


since 


E  (  *■ - — 

icQM  j  eM  |  i  sQ  ^ 


a  )1  «  2  |Q  |a  . 

J  j  €M  J  J 


Finally,  since  all  coefficients  of  (25)  are  positive,  each  coefficient 
whose  value  exceeds  that  of  the  right  hand  side  can  be  reduced  to  the  value 
of  the  latter,  without  cutting  off  any  0-1  point  x  satisfying  (25). [| 

Note  that  if  for  some  i  eQ^  and  jcN  we  have  i  *  i(j),  then  (24)w 

M  M,  Cp 

has  a  term  in  x^  and  one  in  x^.  Each  such  pair  can  obviously  be  reduced  to  a 
single  term,  with  a  corresponding  adjustment  of  the  constant  on  the  right 
hand  side.  This  in  turn  allows  a  further  strengthening.  We  denote 

Qq  -  (i«QMU  *  Kj),  *  J«N‘} 

Q*  *  {leQ^jt  -  t(j)  for  some  jeN  ,  end  >  9^} 
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Q"  »  {ieQ\QMli  *  i(j)  for  some  jetf} 


■  [i  eQM|i  »  i(j)  for  some  j«N-  and  8^  >  q^} 


and  let  Q+  -  QgUQ*,  Q*  -  Q'UQ". 


Remark  9.  The  ineauality  (24)..  imolies 
-  M,cp 


(26)m,* 

where 


E  V.x  +  2  Yix1  >  Y0, 

ieQ+  1  1  ieQ-  1 


Y0  *  max(0,  a!f  -  2  S  -  Z  of} 

U  U  ieQT  1  i«QT  1 


and 


with 


Yt  »  min{Y0,  y/}  ,  ieQ+UQ", 


M 

'ai 

M  ft 

“i  "  3i 

i  eQ1 

isQg 

ft  M 

Vi  *  “i 

ieQ" 

Proof.  For  i  e  Q^, 
M  - 


M 


ai  Xi  +  ^iXi  *  "  3i)*i  + 


while  for  i  e  , 


M  —  MM 

ai  xi  +  ^iXi  “  ^i  “  ai^*i  +  at  ' 


Substituting  these  expressions  Into  (24)^  ^  yields 


E  +  Yi  Xi  +  Z  YiXi  -  Y0 
ieQ+  1  1  ieQ-  11  U 


and  replacing  y^  with  min^,  Y^}  produces  (26)^  ^.ij 


n  J*.'  , 


Theorem  12 »  For  MSN  ,  denote  C(M)  *  MUN  . 

(i)  If  C(M)  Is  a  minimal  cover  for  (2),  then  *  <*g,  ¥  1  e QM,  aad 

9i-V*“VD  <24>m,9- 

(ii)  If  C(M)  is  a  minimal  cover  for  (2)  and  i(j)  e Q\Q^,  ^  jeN 
then  (26)..  -  is  the  same  as  (24).,  .  and  is  of  the  form 

il  |  ■  M  |  Y 


)  E  X.  +  E  X  >  1  . 

M,«p  ieQ+  1  i«Q" 


(iii)  If  C(M)  is  a  minimal  cover  for  (2)  and  i(j)  e for  some  jeN  , 
then  (26).,  is  vacuous. 

Proof .  (i)  Let  C(M)  be  a  minimal  cover  for  (2).  Then 

(28)  Z  |a  |  <  b  -  S  a.  +  |a  \  ,  ¥keMUN" 

jeC(M)  2  jeN"  2  K 

and  therefore,  for  any  ieQ^, 


^  —  a«  >  “ia|akl 

j  eM|  ieQj  2  keM  * 


>  E  a  -  b  -  <£  (from  (28)), 
jeM  2 


^  M 

which  proves  that  *  au,  i  « Q^. 

Also,  for  any  i e and  keN*  such  that  i  *  i(k),  from  (28)  we  have 


?  ,  kl  >  \\\  >  £  \  -  *>  -  V 

j  eN“  |i*i(j’>  J  ieM  1  u 


i.e.,  8t  -  Og,  ¥  jeN  . 

(ii)  If  i(j)  «Q\Qm,  ¥  jeN',  then  Q*UQ‘  -  0,  and  yt  -  aj,  i  eQ+, 
*  8^,  ieQ~.  Thus,  if  this  condition  holds  and  C(M)  is  a  minimal 
cover  for  (2),  then  (26).,  is  the  same  as  (24)  ,  and  it  is  of  the  form 


(iii)  If  C(M)  is  a  minimal  cover  for  (2),  then  form  (i),  ( 24.) 

sa,  9 

is  of  the  form 
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E  ctl  x,  +  £  >  M 

■-«  01  ieO  0  i 


Now  if  i(j*)  e  Qm  for  some  J*«N",  then  yq 


0  and  hence  y^  m  0, 


i«Q+UQ*.| 


Note  that  C(M)  is  a  cover  for  (2)  if  and  only  if  M  is  a  cover  for  (2+). 

If  C(M)  is  a  minimal  cover  for  (2),  then  M  is  a  minimal  cover  for  (2+)  ;  but  the 

converse  is  not  true.  On  the  other  hand,  if  M  is  a  minimal  cover  for  (2*)  and 

[a  |  >  min  a.  for  ail  jeN  ,  then  C(M)  is  a  minimal  cover  for  (2). 

J  ~  ieM 

Example  7.  Consider  the  inequality 


f(x)  »  Sx^x^x^  +  3*2*4  +  4x1*4  ”  ^*lx5*6  ~  *3*5  "  ^*1*3*6  — 

and  let  the  sets  Q^,  i  »  1,...,6,  be  numbered  from  left  to  right.  Choosing 
M  »  fl,2,3}  and  <p  such  that  i(4)  «  1,  i (5)  ■  i(6)  *  3,  one  obtains  the 
inequality  (of  the  form  (24)M 

7x,  +■  6x.  +  3x,  +  7x.  +  2x,  +  5x,  >  8. 

1  2  3  4  1  3  — 


After  reducing  the  terms  involving  the  pairs  (x^,  x^)  and  (x^,  x^), 
one  obtains 


5x^  +  6x^  +  7x^  +  2x^  >  3 


which  in  turn  implies  the  inequality  (of  the  form  (26)^ 

3x^  +  3x2  +  3x^  +  2Xj  >  3. 

Now  let  M  ■  [2}  and  <p  as  above;  then  C(M)  is  a  minimal  cover  for 
f(x)  <  2,  and  i(j)  eQ\H,  ¥  jsN  .  The  corresponding  inequality 

x,  +  x,  +  x,  +  x,  >  1 
2  4  1  3  — 

^  ^  since  M  and  tp  satisfy  the  condition  of  Theorem  12. jj 


is  of  the  form  (27) 


Thus,  when  M5N+  and  cpe'f  are  chosen  such  that  C(M)  is  a  minimal  cover 

for  (2)  and  i(j)  c  Q\QM  for  all  jeN  ,  (26)  takes  on  the  fora  (27)M  of 

n  n,cp  M,  v 

a  generalized  set  covering  inequality.  While  the  generalized  set  covering 
inequalities  (27)^  ^  all  correspond  to  minimal  covers  MCN+t  the  remaining 
generalized  set  covering  inequalities  implied  by  (2),  corresponding  to  minimal 
covers  ,  can  be  derived  by  applying  Theorem  11  to  the  family  of  in¬ 

equalities  (22)  ,  cp  e  ¥  (with  M  a  minimal  cover  for  (22)  ),  rather  than 
v  w 

directly  to  (2).  The  set  of  all  generalized  set  covering  inequalities 
corresponding  to  minimal  covers  for  (2)  has  been  shown  by  Granot  and  Hansaer 
[16]  to  be  equivalent  to  (in  the  sense  of  having  the  same  0-1  solutions  as) 
the  nonlinear  inequality  (2).  Thus,  whatever  additional  inequalities  Theorem 
11  produces,  beyond  the  generalized  set  covering  inequalities  (27),  come  from 
covers  other  than  minimal.  In  the  context  of  linear  inequalities,  it  is  known 
[5,6]  thac  canonical  inequalities  derived  from  minimal  covers  can  usually  be 
strengthened,  and  can  never  be  weakened,  by  extending  the  covers.  Unfortunately 
in  the  case  of  nonlinear  inequalities,  only  the  first  part  of  this  statement 
is  true:  extending  a  minimal  cover  may  weaken  the  inequality  associated  with  it. 
Example  8.  To  show  that  extending  a  minimal  cover  can  actually  weaken 
the  inequality  derived  from  the  cover,  let 

+  6x^x^x^  +  ^x2x4  +  ^xlx3  -  12, 

with  Q1  -  (2,5,6},  Q2  *  (1,3,4},  Q3  ■  (2,4}  and  *  (1,3} .  Applying  Theorem  11 

and  using  the  minimal  cover  M  «  (2,3,4},  we  obtain  the  inequality 
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Extending  now  Ch«  minimal  cover  M  to  {1,2, 3, 4},  we  obtain  the  inequality 

8xx  +  8x2  +  8x3  +  8x4  +  7x5  +  7x6  >  8, 

which  is  actually  weaker  than  (c-dominated  by)  the  first  inequality. || 

Fortunately,  the  phenomenon  illustrated  by  Example  8  can  be  precisely 
characterized. 

Next  we  address  the  practically  significant  question  as  to  when  an 
inequality  (24)^  where  Me(3,  can  be  strengthened  by  expanding  the  set  M. 

As  seen  from  the  previous  discussion,  the  presence  of  indices  ieQ^HQ^ 
denotes  a  certain  ’’weakness”  of  the  inequality,  since  it  offers  a  trivial 
way  of  strengthening  it.  tfe  will  therefore  assume  that,  to  start  with,  M 
is  chosen  such  that  ■  0,  and  that  M  is  expanded  into  a  set  R  such  that 

QR  fl  »  0  too . 

Theorem  13.  Let  MsC,  SCnNm,  R  -  MUS,  and  let  M  and  S  be  such  that  Q  HQ  = 

R  sp 

For  TCQmUQ^,  define 


I(T)  -  (T0Qm)U  (Qs\Qm) 


and 


4(T)  *  « 


M 

OCj  - 


i€TPQM  1  ieTP,Qq 


Then  the  inequality 


(24)R  E  af  x,  +  E  0.X.  >  a* 

i*5R  1  1  ieQ, 


c-dominatas  (24)^  if  and  only  if 

(29)  Z  (|l(T)  HQ  1  -  l)a  <  A(t) 

J«S  2  2 

for  all  TCQ^UQ^  (including  T  ■  0)  such  that  MT)  >  0. 
Proof.  From  the  definitions, 

4*  Z  a 

0  0  j  eS  J 

and  for  i  <  Qg\QM» 

(30)  af  -  ndnCan  +  2  •«.  >  —  *J 

j«S  '  j  eS  [ieQj  J 

-  —  a.. 

J«S|isQ.  2 


To  prove  the  "only  if”  part  of  the  Theorem,  suppose  condition  (29)  is 
violated  for  T*CQX,UQ,1,  such  chat  A(T*)  >  0.  Then  let  x°  be  defined  by 

Q(x°)  -  cqm\t*)  uCQ^nr*). 

If  T*  j*  0,  then  &(T*)  >  0  implies  <  a?,  V  t  e  T*  H  Q  •  hence  for  all 

t  U  Jl 

i  e  T*  n  Qm, 


R  M 
ai  *  «i  + 


j  sS  \  icQj  j 


From  the  choice  of  Q(x  ), 


Q(x°)  -  I(T*)  U(Q  \T*) 'J  (Q\(QRUQsp)] 


Thus  we  have 


* 


-34- 


\  R  ,  x- 

^ -  oc^  +  ^ 


3, 


°i  Xt  +  2  Ml  -  ~i  _  -4 

leQR  l%  i*I(T*)  1  iff**  1 

(32)  -2ZZ:  of  +  >  P.  +  ^ -  (ZI  "  a.) 

ieT*fQM  ieT*%  ieI(T*)  jeS|i«Qj  1 

-  ^ - cff  +  —  3.  +  £  1 1(T*)  Pi Q  la . 

icT*(1QM  1  i«T*PQ^  J«S  J  J 


(33) 


>  J*  +.  r  a  *  rfi 

“  0  j«s  3  0 


where  (32)  follows  from  (30) ,  (31) ,  while  the  inequality  (33)  comes 
assumption  that  (29)  is  violated  for  T*.  Thus  x°  satisfies  (24)_ . 


Z  erf  *°  +  Z  P.x° 
teQM 


Z 


icT*PQ, 


M  * 

®i  + 


z 


M 


isT*DQ 


»1<«S 


from  the 
However, 


since  £(T*)  >  0.  Thus  x°  violates  (24)  ,  hence  (24)  does  not  c-dominate  (24) w 

21  K  M 

To  prove  the  "if”  part  of  the  Theorem,  suppose  (29)  holds  for  all 

TSQwUQ-  such  that  <!(T)  >  0.  Then  let  x*  c  {0,1}**  be  any  vector  that  violates 

(24)  ,  and  define 
21 

T°  -  (QM\Q(x*))U  (Q  nQ(x*)). 


We  have 


ZZ  <rf  +  >  P.  -  Z 

UT°nQM  icTOrq^  icQM 

since  x*  violates  (24)  Thus  4(T°)  >  0. 
*  i  «T°nQ„,  and  (31)  holds  for  all  i  c  T° 
i  c  Qs\Qm. 


1  i 


t«Q. 


3tx*  <  *, 


Further,  if  T°  +  0,  then  a*<3g, 

HQ  .  Also,  (30)  holds  for  all 
21 
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From  Che  choice  of  T°, 

QrHQ(x*)  CI(T°) 

and 

Q  HQ(x*)  -  T°  HQ  . 
y  y 

Therefore  we  have 

Z  a?  X*  +  E  0fx?  ^  2 -  3?  +  >  3, 

UQd  11  ieQ  ieI(T°)  1  ieT°ro  * 

R  $  9 

(34) 

»  i-  ■  g*  *■  >"  3.  +  2  ( I(T°)  HQ  (a 

i«T°PQv  1  teT°nQ  jcS  J  J 

n  cp 

(35)  <  »o  +  2  a'  ’  a0  ’ 

j  eS  ^ 

where  (34),  just  like  (32),  follows  from  (30),  (31),  and  the  strict  inequality 

(35)  follows  since  (29)  is  assumed  to  hold  for  T°. 

Thus  x*  violates  (24)  i.e.,  (24)  c-dotninates  (24)  . ;j 

R  R  M 

At  this  point,  it  should  be  noted  that  when  attempting  to  strengthen 
an  inequality  (24)^  by  expanding  the  cover  M,  it  is  not  always  possible  to 
do  so  sequentially  by  introducing  one  new  term  at  a  time,  as  the  following 
example  illustrates. 

Example  9.  In  the  inequality 

3x.x0  y  5x-xe  +  5x-x,  +  4x0x-x,  y  x*xe  y  x,x.  <12, 

12  15  16  234  35  46  — 

let  the  sets  Q^,  j  ■  6,  be  indexed  from  left  to  right.  Taking 

M  *  fl,2,3,4},  we  obtain  the  inequality 

10x.  y  10x-  y  4x-  y  4x,  y  5x-  +  5x,  >  10. 

1  2  3  4  5  6  — 
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Xf  we  attempt  to  expand  M  by  setting  R  *  MU  {5},  condition  (29)  is  not 
net  for  T  -  {3,5}.  Similarly,  if  we  set  R  -  MU  {6},  (29)  is  violated  for 
T  -  {4,6}.  However,  if  we  set  R  -  MU  {5,6},  then  (29)  is  satisfied  for  all 
T  such  that  4(T)  >  0.|| 

We  now  focus  on  the  case  when  C(M)  is  a  minimal  cover  for  (2),  i.e., 

M  M 

when  *  ckq  for  all  i  e  and  j  eQ^. 

Corollary  13.1.  Let  MCN+  and  SSs\m  be  such  that  Q_  Pi  Q  -  0,  where 

R  cp  * 

R  *  MUS,  and  let  C(M)  be  a  minimal  cover  for  (2).  Then  the  inequality 


(24) 


R  I  a?  +  S  9  x  >  a* 

1  1  KQ,  1  1  0 


c-dominaces  (24)^  if  and  only  if 


(36) 


‘•V^M 


«i  <  ao  • 


Further,  (24)R  strictly  c-dominates  (24)  if  and  only  if  (36)  holds 


and  either 


(37) 


<  On 


for  some  k  % Qw,  or 

(38)  9t  <  al 

for  some  -4  s  Q  . 

9 

Proof.  If  C(M)  is  a  minimal  cover  for  (2),  then  since  *  3^  =  o^, 

^  t  sQm.  j  sQ?,  it  follows  that  4(T)  >  0  implies  T  *  0  and  4(T)  »  au.  Further, 
since  1(0)  »  Qg\Qjj,  condition  (29)  of  Theorem  13  becomes 

£  <iwnv  -  d*j  <4 

or 

i 
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'l 


(X 


ieQSXQM  1  icQSXQK  j 


a.)  <  ou  +  Z  a 
jeS  J 


which  is  (36).  Thus  (36)  is  necessary  and  sufficient  for  (24)  to  c-dominate 

R 


(24) 


M* 


Assume  now  that  (24)  strictly  c-dominates  (24)„.  Then  there  exists 
x°  «  [0,l}q  Chat  satisfies  (24)^  (which  implies  Q(x°)  ^  0) ,  but  not  (24)R. 
Then  there  exists  either  k  eQ(x°)  0 such  that  (37)  holds,  or  l  eQ(x°) 
such  that  (38)  holds. 

R  R  a 

Conversely,  if  there  exists  k  e such  that  <  aQ,  then  x*  e  [o,i}q 

defined  by  Q(x*)  «  {k}  satisfies  (24)M  but  not  (24) R;  and  an  analogous 

argument  holds  if  there  exists  l  e  Q  such  that  3.  <  <JJ.|| 

v  u 

An  Important  practical  consequence  of  Corollary  13.1,  which  is  used 
in  the  Algorithm  of  Che  next  section,  can  be  stated  as  follows.  Like  in 
section  2,  we  define  for 


Ei(M)  *  £j  eN^I lQj\QMl  -  i},  i  -  0,1 


,P, 


where  p  »  max  W  ,\Qm|  ,  and  denote  E(H)  »  En(M)  UE.(M). 
j  eN  J  1 

Corollary  13.2.  Let  M,  S  and  R  be  as  in  Corollary  13.1.  If  SCE(M), 

then  (24)  c-dominates  (24),.. 

R  M 

Proof.  Let  SCE(M)  and  denote  =  S  OE.(M),  i  ■  0,1.  Then  S  =  S^'JS^, 

and 


for  j  eSQ 
for  jeS^ 


Hence 

(39)  ^  of  -  E  a  <  +  Z  a, 

ieQs\QM  1  jsS1  J  0  jeS  j 


i.e.,  (36)  is  satisfied. \\ 
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Thus  any  minimal  cover  MSN'  for  (2  )  can  safely  be  extended  to 
include  all  terms  in  E(M),  without  weakening  the  inequality  (24)^.  However, 
we  can  often  go  beyond  E(M),  as  will  be  clear  when  we  restate  Corollary  13.1 
in  slightly  different  form. 

Corollary  13.3.  Let  M,  S  and  R  be  as  in  Corollary  13.1,  and  let 

R  *  RHE,  CM),  i  *  l,...,p.  Then  the  inequality  (24)  c-dominates  (24)  if 
1  i  KM 

and  only  if 

P 

(39)  2  t (i  -  1)  E  a.]  <  2  a.  -  b. 

i*2  je\  J  JSRq  2 

Further,  (24)^  strictly  c-dominates  (24)^  if  and  only  if  (39)  holds 
and  either 

(40)  <>,  I  ■■■—  a .  >  b 
jsRlkiQ^  2 

for  some  k  c  Q^,  or 


jeN-|-t*i(j)  j 


for  some  €  Q^. 

¥ 

Proof.  We  sho*?  that  conditions  (39),  (40)  and  (41)  are  equivalent 
to  conditions  (36),  (37)  and  (38)  of  Corollary  13.1. 

For  i  e  Qs\Qm, 


while 


orf  .  .?  .  ■  a  (*  a  since  for  jeR\S,  i  i  Q  )  , 

jeSjieQ^  2  jeRjisQ^  2  2 


R 

a0 


b. 


Thus  condition  (36)  amounts  to 
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(42)  ±— ...  or*  »  2  l(Qs\QM)nQ  [a  <  Z  a  -  b  «  a*  • 

i*Qs\QM  1  jeR  S  ]J  ] 

P 

Now  R  *  U  R.  ,  and  for  jcR.  ,  |  (Q-\Qm)  HQ.  *  i,  i  3  0, 1, . . . ,p. 
i-0  1  1  b  n  J 

Hence  from  (42)  we  have 

P  P 

Z  a.  -  b  >  Z  (i  Z  a.)  -  Z  (  S  a  ) 

jeRQ  2  1-2  jeR  J  i-2  3*^ 


P 

-  Z  [(l  -  1)  Z  a  ]  , 
i-2  j  aR  2 

which  is  p-ecisely  (39).  Thus  (39)  is  equivalent  to  (42),  hence  to  (36),  and 
this  proves  the  first  statement. 

On  Che  other  hand,  (37)  can  be  restated  as 

>  a.  <  Z  a.  -  b 

jeR|keQj  J  j.sR  ^ 

which  is  equivalent  to  (40).  Also,  (38)  can  be  written  as 


S  \*A  <  2  a  -  b, 

j€N*|^i(j)  J  j  eR  J 


which  13  Che  same  as  (41).  This  proves  the  second  statement, jj 


Condition  (39)  of  Corollary  13.3  gives  the  precise  extent  to  which  a 
minimal  cover  M  for  (2+)  (such  that  QWH  Q  *  0)  can  be  extended  beyond  the 

n  Cp  ■■  * 

sets  Eq(M)  and  E^(M),  into  sets  E^(M)  for  i  >  2.  This  is  extensively  used 
in  the  Algorithm  described  in  section  4. 

In  particular,  using  Theorem  10  to  replace  the  inequality  (2)  by  the 


set  of  inequalities 
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(22) 


9 


f+(x) 


Z 

jetr 


*i(j)  -  b 


(-  b 


j  eN 


-V* 


9  e 


where  i(j)  *  <p(Q^),  jeN*,  we  have 

Corollary  13.4.  Lee  M  be  a  minimal  cover  for  (22)  .  lee  SCN\M, 

cp 

R  *  MUS  and  R^  *  RflE^(M),  i  *  0,  l,...fp.  Assume  M  and  S  are  such  Chat 
RflN^nQ^  »  0.  Then  Che  inequality 


<43>r 


> —  ■ 

ieQRnN+ 


R  ~ 
“i  Xi 


+  2Z 

i«Q 


RCN' 


c-dominates  the  inequality 

(«), 


M 


.cQjjTTN' 


I  x.  +2 
t+  i 


isQ^jlUT 


x .  >1 

i  — 


if  and.  only  if 


P 

(44)  2  [(i  -  1)  Z  a  ]  <  Z  a  -  b; 

i=2  jeR  J  jeR  J 


and  (43)r  strictly  c-dominates  (43)^  if  and  only  if  (44)  holds  and  there 
exists  k  e  Q„  such  that 

(45)  2ZZ  a.  >  b. 

jeR|k^Qj  J 


Proof.  By  specializing  Corollary  13.3  to  inequality  (22)u.|| 

The  following  example  illustrates  the  usefulness  of  these  results 
for  obtaining  a  more  compact  equivalent  linear  system  to  a  nonlinear  inequality 
(2)  than  the  set  of  generalized  covering  inequalities. 
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Example  10.  Consider  the  inequality 

(46)  10x^»9  +  9x2x8  +  8x3x7  +  8xlx6  +  8x3x4  +  5x2x5  —  20 * 

Thera  are  20  minimal  covers  M  for  (42),  and  the  corresponding  sets  Q,„ 

M 

are  shown  in  the  table  below. 


Minimal  Cover  (M) 

#  1 
2 

3 

4 

5 

6 
7 
3 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


1  2  3  7  8  9 

1  2  6  8  9 

1  2  3  4  8  9 

1  2  5  8  9 

1  3  6  7  9 

1  3  4  7  9 

1  2  3  5  7  9 

1  3  4  6  9 

1  2  5  6  9 

1  2  3  4  5  9 

1  2  3  6  7  8 

2  3  4  7  8 

2  3  5  7  8 

1  2  3  4  6  8 

1  2  5  6  8 

2  3  4  5  8 

1  3  4  6  7 

1  2  3  5  6  7 

2  3  4  5  7 

1  2  3  4  5  6 


Replaced  by 

B 

D 

B 

D 

E 

E 

B 

E 

D 

B 

B 

C 

C 

B 

D 

C 

E 

B 

C 

B 


Applying  the  Corollaries  to  minimal  covers  20,  19,  15,  and  17, 


respectively,  we  obtain  the  linear  inequalities 
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(A)  18x^  4  +  16x^  4  8x^  4  5Xg  4  8x^  4*  8x^  +  9x^  4  1  Ox^  >  28 

(B)  lOx^  +  10x^  +  8x^  4  5xg  4  8x^  4  9x^  >  10 

(C)  12x^  4  12x^  +  5x^  +  8x^  4  9xg  4  10x^  >  12 

(D)  14x^  +  14x3  4  8x^  4  8x6  4  8x7  4  10x9  >  14, 

which  c-dominate  all  the  set  covering  inequalities  corresponding  to  the 
minimal  covers.  Whereas  a  system  of  20  set  covering  inequalities  were 
previously  required  to  linearize  (46),  the  system  of  four  inequalities  (A) -(D) 
is  equivalent  to  (46) . [j 

We  conclude  this  section  by  considering  whether  the  multilinear 
inequality  (2)  can  best  be  linearized  by  applying  the  relevant  results  directly 
to  inequality  (2)  in  the  manner  previously  described,  or  alternatively  applying 
them  to  an  equivalent  set  of  inequalities  implied  by  (2).  In  particular,  if 
we  consider  (2)  to  be  a  linear  inequality  in  the  0-1  variables 

y  «  n  x  ,  jsN 

1  ieQj  1 

and  denote  it  by  (2)  ,  then  w.l.o.g.  we  may  assume  that  a^  >  0  for  all  j eN, 

and  that  a.  >  a  >  ...  >  a  .  Then  applying  the  results  of  [6],  [5],  we  can 
1  *  2  *  ~  n 

replace  (2)^  by  the  equivalent  set  of  canonical  inequalities 

(47)s  * -  y.  <  \s\  -  1  ,  S  eK  . 

S  jeS(S)  j 

Here  £(S)  is  the  extension  of  S,  defined  as 
e<S)  -  5  U  { j  cN\S  |  j  <  JlJ, 


i 
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with  j-  *  min  j;  while  K  is  the  family  of  strong  covers  for  (2)  ,  where 
1  S  7 

a  minimal  cover  S  is  called  strong  if  there  exists  no  minimal  cover  T  ^  S 

such  that  |T|  *  Js|  and  C(S)  S6(T) . 

For  any  given  S  rewriting  (47)^  in  terms  of  x,  we  can  linearize  it 
using  the  above  results.  If  we  do  this  for  every  S  e>C,  we  obtain  a  new 
linearization  of  (2) ,  different  from  the  one  discussed  earlier.  Naturally, 
the  question  arises  as  to  how  this  new  linearization  compares  with  the  one 
discussed  above.  Both  approaches  were  implemented  and  tested,  and  the  computa¬ 
tional  results  are  reported  in  section  5. 

In  [5],  a  procedure  was  given  for  strengthening  canonical  inequalities 
of  the  form  (47)^  by  increasing  their  left  hand  side  coefficients  that  satisfy 
a  certain  condition.  Though  the  strengthened  inequality  strictly  dominates  and 
sometimes  strictly  c-dominates  the  canonical  inequality  (47)^,  it  is  not 
necessarily  true  that  linearizing  the  strengthened  inequality  is  preferable 
to  linearizing  the  inequality  (47)^.  We  have  derived  some  sufficient  condi¬ 
tions  for  the  linear  inequality  associated  with  a  certain  cover  M  for  the 
strengthened  inequality,  to  dominate  the  linear  inequality  associated  with 
the  same  cover  M  for  the  canonical  inequality  (47)^.  However,  in  our  computa¬ 
tional  experiments  we  found  that  the  particular  sufficient  condition  that 
we  have  implemented  was  rarely  satisfied;  therefore  we  have  not  pursued  any 
further  the  idea  of  using  strengthened  inequalities  instead  of  the  family  (47). 

4.  An  Algorithm  for  Solving  Multilinear  0-1  Programs 

Next  we  address  the  multilinear  0-1  program 

Max  2  c  x 
icQ  1  t 

(ML?)  2  *kj(S=  ^  bk  >  k£iC 

ie\  lsQki 


x,  «  0  or  1,  i  eQ 
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wh«rs 


Q 


U 

keK 


The  algorithm  that  we  preseat  below,  like  the  oae  by  Granot,  Granot 
aad  Kallberg  [IS],  generates  some  linear  inequalities  implied  by  the  constraint 
set  of  (MLP),  and  solves  the  resulting  linear  0-1  program,  which  is  a  relaxa¬ 
tion  of  (MLP).  At  iteration  t,  let  this  linear  0-1  program  be  denoted  (P£). 

If  an  optimal  solution  to  (P£)  is  feasible  for  (MLP),  then  it  is  optimal  for 
(MLP)  aad  we  stop.  Otherwise  we  generate  a  new  set  of  linear  inequalities 
implied  by  the  constraints  of  (MLP) ,  such  that  the  new  inequalities  cut  off 
the  solution  to  (P^),  and  solve  the  linear  0-1  program  (?t+^)  obtained  from 
(P£)  by  adding  the  new  inequalities.  Since  at  every  iteration  the  solution 
to  the  current  problem  (P^)  is  cut  off,  the  algorithm  is  obviously  finite. 

Our  procedure  differs  from  that  of  [15,  14]  mainly  in  that  we  use  a  more 
compact  linearization,  based  on  the  theory  of  sections  2-3.  To  be  more 
specific,  we  start  with  a  set  covering  inequality  associated  with  a  minimal 
cover,  but  then  use  Theorem  13  and  its  Corollaries  to  extend  the  cover  so 
as  to  obtain  as  strong  an  inequality  as  the  conditions  of  the  Corollary  permit. 
Experience  shows  that  the  proportion  of  minimal  covers  that  be  extended  is 
very  high  (90%  is  a  typical  case)  and  tends  to  increase  with  the  number  of 
terms  per  constraint.  Since  the  use  of  extended  covers  tends  to  produce 
smaller  cardinality  linear  equivalents  of  each  nonlinear  inequality,  it  can 
also  be  expected  to  reduce  the  number  of  iterations  needed  to  solve  (MLP). 

This  is  indeed  the  case,  except  for  problems  with  very  few  terms  per 
constraint,  as  shown  by  the  computational  experience  discussed  in  the  next 


section. 
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While  the  procedure  outlined  above  is  finite,  it  may  take  many 
iterations.  We  found  it  therefore  preferable  not  to  solve  (P  )  exactly 
at  every  iteration,  but  use  a  heuristic  to  find  an  approximate  solution. 

We  proceed  this  way  until,  at  some  iteration  t,  an  approximate  solution  to 
(P^)  is  found  to  be  feasible  to  [MLP).  At  that  point  we  replace  the  heuristic 
by  an  exact  algorithm.  The  particular  heuristic  that  we  use  on  the  sequence 
of  linear  0-1  programs  (P^)  is  the  Pivot  and  Complement  procedure  of  Balas 
and  Martin  [7]  .  When  we  switch  to  an  exact  algorithm,  we  use  a  branch  and 
bound/ implicit  enumeration  procedure  implemented  by  C.  H.  Martin. 

Another  deviation  from  the  above  outline  is  that  we  found  it  convenient 
to  periodically  remove  some  of  the  linear  inequalities  generated  earlier. 

This  is  done  according  to  a  particular  procedure  so  as  to  insure  that  con¬ 
vergence  is  maintained. 

Finally,  to  facilitate  the  search  for  minimal  covers  and  their  extensions, 
used  in  the  linearization  procedure,  we  start  the  algorithm  by  ordering  once 
and  for  all  the  terms  of  each  constraint  according  to  decreasing  absolute 
values  of  their  coefficients. 

As  a  starting  solution  we  use  the  optimal  solution  to  the  unconstrained 
problem,  i.e.,  x°  defined  by  x°  *  1  if  c^  >  0  and  x°  *  0  otherwise. 

A  flowchart  of  the  algorithm  is  shown  in  fig.  1. 

The  heart  of  our  procedure  is  of  course  the  generation  of  linear 
inequalities.  Since  the  conditions  of  Theorem  13  and  its  corollaries  do  not 
uniquely  determine  the  "best"  Inequality  that  meet9  them,  we  have  to  describe 
the  particular  algorithm  that  we  use  to  generate  the  inequalities. 

First,  it  should  be  stated  that  at  every  iteration  we  generate  one 
linear  inequality  from  every  inequality  of  (MLP)  violated  by  the  current 
solution  x°,  except  for  the  first  iteration,  when  we  generate  one  linear 
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Fig.  1.  Flowchart  of  che  algorithm 


i 
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inequality  (using  the  cover  M  »  N)  from  every  constraint  of  (ML?) ,  whether 
violated  or  not  (the  exception  was  adopted  as  a  result  of  computational 
experimenting).  To  describe  the  procedure,  let 

(2)  Z  a  (  tt  x  )  <  b 

jeN  J  ieQ^  * 

be  one  of  the  inequalities  violated  by  x°,  and  let  (a^|  >  [a^J  >  ...  >  (a^ 
Denote 

P+(x°)  -  [j  eN+|  tt  x°  -  1}, 

isQj 

p“(x°)  -  U«N‘|  tt  x°  •  0}, 
ieQj  1 

with 

?(x°)  *  ?+(x°)  U  ?’ (x°)  , 

and  define 

$’(x°)  •  C<Pe  *  0,  ¥■  j  ep"(x°) } . 

If  x°  violates  (2),  it  also  violates  the  inequality 


(22) 


V 


E  a,  (  tt  x  )  +  Z 
jeN*  J  ieQj  1  jeN" 


'V*i(J)*b  (*b 


Z 

jeN* 


V 


for  every  cpc$~(x°),  and  §~(x°)  +  0  by  definition.  Thus,  given  x°  and  the 
family  of  inequalities  (22)^,  c?e$(x°)  (corresponding  to  a  particular 
inequality  (2)),  violated  by  x°,  our  cut  generating  algorithm  consists  of 
the  following  sequence  of  steps: 

1.  Finding  a  convenient  minimal  cover  MSN,  i.e.,  such  that  x° 
violates  the  generalized  covering  Inequality  corresponding  to  M. 


! 

t 
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2.  Extending  M  to  a  maximal  sec  RSN+  satisfying  che  condition  (44). 

3.  Choosing  a  convenient  mapping  (pci  (x°) ,  i.e.,  one  that  avoids  as 
much  as  possible  producing  nonzero  coefficients  for  complementary  pairs  of 
variables,  and  including  n”\M  in  R. 

A  discussion  of  each  step  follows. 

1.  Let  P(x°)  ■  }  be  ordered  by  the  same  rule  as  N,  i.e., 

k  *  l,...,t  -  1.  Let  j«£l,...,t}  be  the  largest  integer  such  chat 
is  a  cover,  and  let  l  e  [ j  ,  j  +  1, . . . ,  t}  be  the  smallest 

integer  such  that 
^  *  [ij  > 

is  a  cover  for  (2).  Then,  obviously,  M  is  minimal.  Also,  M  is  a  minimal 
cover  for  (22K  for  any  qpe§~(x°).  Further,  for  any  9ei“(x°),  M  satisfies 
the  requirement  of  Corollary  13.4,  i.e.,  M(lN+nw^  *  0;  and  for  any  such  cp, 
the  generalized  covering  inequality 

2Z  x.  +  >  x,  >  l 
ieQMHN+  isQMntT 


corresponding  to  M  is  violated  by  x  . 

2.  Construct  che  extension  R  of  M  as  follows.  Define 

Et(M)  »  «n| \Q  \Qm|  -  i},  i  -  0,  l,...,p, 

and  set  E(M)  *  Eq(M)  UE^(M).  Mote  that  N  CE(M).  First  include  in  R  the 
set  E(M)nN+.  Next,  for  i*2,..,,p,  consider  the  elements  of  E^(M)  (which 
all  belong  to  N+ )  in  order  of  increasing  a  ^ ,  and  include  into  R  as  many  as 
can  be  included  without  violating  condition  (44).  If  all  can  be 

included,  set  i  —  i  +  1  and  repeat*  Otherwise  stop  with  the  last  element  of 
E^(M)  whose  inclusion  into  R  does  not  lead  to  a  violation  of  (44) % 


i 
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3.  To  choose  the  mapping  <pe$'(x°),  for  j  elf  DM,  let  <?(Q^)  be  the 
first  index  icQ^  such  chat  x°  -  0.  For  jeff\M,  let  R  be  the  extended  set 
resulting  at  the  end  of  step  2  and  let  or^,  i  s Q  f 0 } ,  be  the  corresponding 
coefficient  values,  where  R  and  the  are  updated  by  combining  variables 
and  their  complements  whenever  such  pairs  occur.  Since  it  is  possible  for 
either  or  x ^  (but  never  for  both)  to  appear  in  the  resulting  inequality 
(24)R,cp*  we  partition  Q  into  QR,  QR  and  Q°,  where 

QR  *  'l€QRtxi  aPPears  ln  (24)r>cp^  » 

QR  *  ^ieQR^Xi  aPP®ars  in  (24)r,-j}  • 


Q°  »  QVQ*UQ’). 

We  then  choose  i(j)  *  <P(Q^)  according  to  the  following  rule: 

If  Qj\QR  J4  let  i ( j )  be  the  first  index  in  Q^\Qr. 

If  Q  \Q  *  0  but  Q*  *  Q  0 Q"  *  0,  let  i(j)  -  h  where  J  -  max  a*. 
j  R  J  j  R  h  isQ*  1 

Otherwise,  let  i(j)  •  k,  where  -  min 

i«Qj  L 

Once  i(j)  is  selected,  set  R  -  RU{i(J)},  update  aR  and  J*  as  well  as 

+  -  o  ^  V  J  )  0 

V  QR  and  Q  (combining  variables,  if  necessary),  and  proceed  to  the  next 
Having  generated  the  linear  inequality,  we  eliminate  the  complemented 
variables,  i.e.,  restate  the  inequality  in  the  original  variables,  and  add 
it  to  Che  current  linear  0-1  program. 

Next  we  illustrate  the  procedure  on  an  example. 

Example  11.  Consider  the  multilinear  inequality 

16x2x4x5  ’  10x2X6  +  10xlx2x3  +  5xlx5  *  4x5x7  +  4x3x5  <  I, 
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0- 


which  is  violated  by  x°  -  (1,1, 1,0, 1,1,0) .  We  have  -  {2,4,5},  Q2  -  {2,6}, 
Q3  -  {1,2,3},  Q4  -  {1,5},  Qs  -  {5,7},  Q6  »  {3,5}.  Further,  N+  -  {l,3,4,6}, 

N"  -  {2,5},  and 

P*(x°)  -  {3,4,6},  P'(x°)  -  {5}  P(x°)  -  {3, 4, 5, 6}. 

The  corresponding  inequality  with  positive  coefficients  is  (in  general 

form) 

(49)  16x2x4x5  +  UC1(2)  +  lOXlx2x3  +  Sx^  +  **1(5)  +  4x3x5  <  15, 

where  i(2)  and  i(5)  depend  on  the  choice  of  q>  e 4  (x°) .  Since  in  this  case 
i  (x°)  is  the  set  of  those  such  that  <p(Q$)  *  i(5)  =  7,  only  the  choice  of 
i(2)  remains  open. 

1.  We  identify  the  minima?  cover  M  *  {3,4,5}  for  (48),  which  is  also 
a  minimal  cover  for  (49) .  We  have 

^MPN+  * 

and  applying  Theorem  11  to  (49),  we  obtain  for  the  minimal  cover  M  the 
generalized  covering  inequality 

(50)  X1  +  x2  +  x3  +  x5  +  *7  -  * 

violated  by  x°. 

2.  We  identify  the  sets 

EQ(M)  «  {3, 4, 5, 6}  ,  Er(M)  -  {1,2}, 

and  since  E  (M)  «  0  for  i  >  2,  we  have  R  *  E (M) H N+  -  {1,3, 4, 6}. 

3.  For  j  *  5  (j«H  OM) ,  we  set  i(5)  »  7,  since  x°  •  0,  and  update  R 
by  including  {5}.  For  j  »  2  (jeiAji),  we  set  1(2)  -  6,  since  Q2\QR  *  {6}, 


-St¬ 


and  update  R  by  Including  (2}.  Thus  R  *  (1,2, 3 ,4, 5, 6},  and  by  applying 
Theorem  11  to  (49)  (with  i(2)  =  6  and  i(5)  *  7) ,  we  obtain  for  the  extended 
cover  R  the  inequality 

(51)  15x.  +  26x-  +  14x0  4-  16x.  +  25x_  +  10x,  +  4x_  >  34 

1  2  3  4  5  6  7 

which  is  also  violated  by  x°,  and  which  strictly  c-dominates  the  generalized 
covering  inequality  (50)  .j| 

As  mentioned  earlier,  we  found  it  necessary  to  periodically  remove 
inequalities  from  the  linear  0-1  program  in  order  to  keep  its  size  within 
manageable  limits.  The  cut  dropping  procedure  operates  as  follows.  The  set  V 
of  all  inequalities  generated  during  the  procedure  is  partitioned  into 
3  subsets.  contains  exactly  one  inequality  generated  at  each  iteration, 
namely  the  one  derived  from  the  most  violated  constraint  of  (MLP) .  Cuts  in 
are  never  removed,  as  a  guarantee  that  every  solution  to  the  linear  0-1 
program  generated  during  the  procedure  is  cut  off  by  at  least  one  inequality. 

consists  of  all  inequalities  associated  with  extended  covers  and  not 
contained  in  V^,  whereas  consists  of  the  remaining  inequalities  (i.e., 
those  associated  with  minimal  covers  that  could  not  be  extended). 

Whenever  the  number  of  inequalities  in  the  linear  0-1  program  attains 
a  predetermined  threshold  value  A,  all  inequalities  in  not  binding  at  the 
current  solution  are  dropped.  The  subset  is  our  first  preference  for 
dropping,  since  it  usually  consists  of  the  weakest  inequalities  of  the  current 
system.  If  removing  the  nonbinding  inequalities  in  V ^  is  not  sufficient  for 
accommodating  all  the  inequalities  generated  at  the  current  iteration,  then 
the  nonbinding  inequalities  in  are  also  dropped.  Finally,  if  removing  all 
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Che  aoabindiag  inequalities  of  V 3  and  is  s till  insufficient,  we  drop  an 
appropriate  number  of  binding  inequalities  in  and,  if  necessary,  in  V^. 

This  completes  the  description  of  the  main  version  of  our  algorithm, 
henceforth  called  Algorithm  X.  Two  additional  versions  of  the  algorithm  were 
implemented,  which  will  now  be  briefly  described. 

Algorithm  II  differs  from  Algorithm  I  in  that  it  generates  linear 
inequalities  not  directly  from  an  inequality  (2)  of  (MLP) ,  but  from  an  extended 
canonical  inequality  implied  by  (2)^,  as  described  at  the  end  of  section  3, 

The  choice  of  the  inequality  (2),  respectively  (2)y,  as  well  as  that  of  the 
minimal  cover  M,  is  the  same  as  in  Algorithm  I.  Another  minimal  cover  C  is 
then  identified,  such  that  jc|  =«  |m|  and  £(M)  s£(C)  (preferably,  but  not 
necessarily,  C  ^  M)  .  The  cut  generating  procedure  described  above  is  then 
applied  to  the  canonical  inequality  defined  by  £(M)  and  expressed  in  terms 

of  x,  for  which  M  is  still  a  minimal  cover.  Everything  else  is  as  in  Algorithm  I. 

Finally,  Algorithm  III  differs  from  the  other  two  versions  by  the 
fact  that  it  derives  only  generalized  covering  inequalities  corresponding  to 
minimal  covers,  without  attempting  to  strengthen  them  by  extending  the  covers. 

For  this  version,  the  choice  of  the  minimal  cover  is  done  differently,  namely 
by  setting  M  *  (i^,...,i^},  where  fc  is  the  smallest  integer  such  that  M  is 
a  cover.  As  a  result,  M  (which  is  of  course  minimal)  is  of  smaller  cardinality 
than  the  cover  selected  in  Algorithm  1  which  in  the  absence  of  the  extension 
procedure  is  preferable.  The  superiority  of  this  choice  of  minimal  cover  for  this 
particular  algorithm  was  unequivocally  supported  in  the  computational  testing. 

The  other  ingredients  of  Algorithm  III  are  the  same  as  those  of  I  and  II, 

Algorithm  III  should  be  viewed  as  our  version  of  the  Granot  and  Granot  algorithm 
[14];  the  differences  from  the  latter  (improvements  in  our  view)  having  been 
adopted  in  order  to  make  it  comparable  with  Algorithms  I  and  II, 
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Algorithm  1,  which  is  by  far  the  most  efficient  of  the  three  procedures 
implemented,  was  also  run  in  the  heuristic  mode,  i.e.,  by  removing  all  steps 
subsequent  to  the  finding  of  a  feasible  solution  to  (MLP) .  The  purpose  of 
this  exercise  was  to  obtain  information  on  the  quality  of  the  solutions 
obtainable  by  such  an  approach. 

5 .  Computational  Results 

The  algorithms  discussed  above  were  coded  in  FORTRAN  and  tested  on  a 
DEC  20/60  on  a  series  of  randomly  generated  test  problems. 

The  first  set  of  test  problems  consists  of  60  multilinear  0-1 
programs,  5  in  each  of  12  classes  that  differ  among  themselves  in  the  number 
of  terms  per  constraint.  The  number  of  constraints  and  variables  (denoted  by 
m  and  a  respectively)  is  the  same  in  all  of  these  problems  (m  -  10,  a  *  30), 
and  the  number  of  terms  per  constraint  is  randomly  drawn  from  a  uniform 
distribution  on  the  interval  [3,  T] ,  where  T  is  shown  in  Table  1.  The 


constraint  coefficients  a^_.  are  integers  uniformly  distributed  on  [-  5,  15], 
while  the  b,  are  integers  drawn  from  a  uniform  distribution  on  (0.3s,  ,  0.8s,), 


where  31  Zj  a^.  The  cost  coefficients  c_.  are  uniformly  distributed  integers 
on  [1,  20] .  Finally,  the  number  of  variables  per  term  is  uniformly  distributed 


on  [2,6].  The  results  are  shown  in  Table  1. 

All  test  problems  were  run  under  two  kinds  of  limitations,  shown  in 
the  tables:  a  time  limit  (3,  5  or  10  minutes,  depending  on  the  phenomenon 
studied)  and  a  limit  of  150  on  the  number  of  iterations,  hence  on  the  number 
of  nonremovable  inequalities  generated,  due  to  space  limitations.  The  latter 
limit  is  different  from  the  threshold  value  A  that  triggers  the  cut  dropping 
routine.  Ir.  Algorithms  I  and  II,  after  some  experimentation  A  was  set  to  2n, 
i.e.,  twice  the  number  of  variables;  whereas  in  Algorithm  III  computational 
tests  indicated  a  higher  value,  and  A  *  150  was  adopted. 


-54- 


All  CPU  times  reported  are  exclusive  of  input/output  time  and  the 
preprocessing  time  required  to  sort  the  (absolute  values  of  the)  coefficients 
of  the  multilinear  constraints.  The  maximum  input  time  for  any  of  the  test 
problems  was  0.416  seconds,  and  the  maximum  preprocessing  time  was  0.093 
seconds . 
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Table  1.  Number  of  problems  solved  and  average  CPU  time  (seconds).  *  * 


Algorithm  I 

Algorithm  II 

Algorithm  III 

m 

a 

T 

No.  Solved  Time 

No.  Solved  Time 

No.  Solved  Time 

i 

10 

30 

10 

5 

38.7 

5 

16.8 

5 

17.9 

10 

30 

20 

5 

4.2 

5 

4.2 

5 

2.6 

10 

30 

30 

5 

91.8 

4 

77.0 

3 

122.3 

10 

30 

40 

5 

57.8 

3 

81.7 

3 

85.2 

10 

30 

50 

5 

95.2 

2 

110.7 

2 

112.1 

10 

30 

60 

4 

56.5 

2 

109.9 

1 

165.8 

1.  5  problems  per  class. 

2.  Time  averaged  for  all  5  problems 

3.  Limit  set  to  3  minutes  CPU  time  or  150  iterations  per  problem. 

Table  1  shows  that  although  Algorithm  III  performs  somewhat  better  than 
Algorithm  1  on  the  problems  with  T  *  10  and  T  *  20  (i.e.,  with  5  and  10 
constraints  on  the  average,  respectively),  its  performance  quickly  deteriorates 
for  higher  values  of  T,  as  reflected  in  the  sharply  decreasing  number  of 
problems  solved  within  the  limits  allowed.  At  the  same  time,  the  performance 
of  Algorithm  1  is  only  moderately  affected  by  the  increase  of  T.  As  to 
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Algorithm  II,  its  performance  is  not  better  than  that  of  III  on  the  problems 
with  small  T,  and  considerably  worse  than  that  of  Algorithm  I  on  the  problems 
with  large  T.  Thus  the  performance  of  Algorithm  II  will  not  be  further  pursued 
Table  2  compares  the  performance  of  Algorithms  I  and  III  on  the  same 
set  of  problems  with  a  time  limit  of  10  instead  of  3  minutes. 

12  3 

Table  2.  Number  of  problems  solved  and  average  CPU  time  (seconds).  *  * 


Algorithm  I 

Algorithm  III 

m 

n 

T 

No.  Solved  Time 

!  No.  Solved  Time 

10 

30 

10 

5 

38.7 

5 

17.9 

10 

30 

20 

5 

4.2 

5 

2.6 

10 

30 

30 

5 

91.8 

5 

257.5 

10 

30 

40 

5 

57.8 

3 

253.2 

10 

30 

50 

5 

95.2 

2 

333.4 

10 

30 

60 

5 

81.7 

2 

344.9 

1.  5  problems  per  class. 

2.  Time  averaged  for  all  5  problems. 

3.  Limit  set  to  10  minutes  CPU  time  or  150  iterations  per  problem 

The  results  show  an  even  sharper  contrast  between  the  sensitivity  of 
the  two  algorithms  to  an  increase  in  the  number  of  terms  per  constraints. 

We  conclude  that  the  more  compact  linearization  based  on  the  theory  of 
sections  2-3  definitely  pays  off  for  problems  with  more  than  20  terms  per 


constraint. 
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In  Table  3  we  compare  the  average  number  of  iterations  and  cuts 
(linear  inequalities)  generated,  in  order  to  better  understand  the  difference 
in  the  performance  of  the  two  algorithms.  We  see  that  as  T  is  increased 
from,  say,  30  to  60,  the  number  of  iterations  and  cuts  increases  by  more 
than  300%  for  Algorithm  III,  as  opposed  to  10-15%  for  Algorithm  I.  On  the 
other  hand,  while  the  percentage  of  covers  that  can  be  extended  (in  Algorithm  I) 
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Table  3.  Number  of  iterations  and  of  cuts.  *  * 


Algorithm  I 

Algorithm  III 

m 

B 

B 

Iterations 

Cuts 

Percent  Covers 
Extended 

Iterations 

Cuts 

10 

30 

10 

6.6 

32.6 

89.0 

i 

9.0 

32.4 

10 

30 

20 

4.2 

25.2 

94.6 

6.8 

27.4 

10 

30 

30 

8.8 

41.0 

94.2 

26.0 

108.0 

10 

30 

40 

9.2 

38.6 

95.1 

57.2 

212.0 

10 

30 

50 

9.6 

41.8 

98.9 

78.2 

340.6 

10 

30 

60 

10.2 

45.6 

98.8 

100.0 

455.2 

1.  5  problems  per  class. 


2.  Values  averaged  for  all  5  problems. 

3.  Limit  set  to  10  minutes  CPU  time  or  150  iterations  per  problem. 

increases  with  T,  the  increase  is  only  modest,  since  this  percentage  is  high 
to  begin  with  (i.e.,  for  all  problem  classes).  This  modest  increase  cannot 
fully  account  for  the  sharply  increasing  difference  in  the  number  of  iterations 
required  by  the  two  Algorithms.  What  the  table  does  not  show,  however,  is 
that  as  the  number  of  terms  per  constraint  increases,  not  only  does  the  per¬ 
centage  of  covers  that  can  be  extended  increase,  but  more  importantly,  there 


* 
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is  a  significant  increasa  in  the  extent  to  which  every  minimal  cover  can 
be  extended:  with  more  terms  per  constraint,  many  more  indices  are  included 
in  the  extension  of  each  cover. 

In  Tables  4  and  5  we  illustrate  the  effect  of  an  increase  in  the  number 
of  variables  and  constraints,  respectively,  on  the  performance  of  Algorithm  I. 
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Table  4.  Effect  of  an  increase  in  the  number  of  variables  (Algorithm  I)  *  9 


m 

n 

T 

No.  Solved 

i 

Time 

(seconds) 

Iterations 

Cuts 

-  - 

Percent  Covers 
Extended 

10 

30 

30  S 

1 

i 

91.3 

j 

8.8 

41.0 

94.2 

10 

40 

30 

104.6 

11.6 

43.6 

96.6 

10 

50 

30 

IBH 

82.5 

9.2 

40.2 

i 

95.1 

1.  5  problems  per  class. 

2.  Values  averaged  for  all  5  problems. 

3.  Limit  set  to  3  minutes  CPU  time  or  150  iterations  per  problem. 
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Table  5.  Effect  of  an  increase  in  the  number  of  constraints  (Algorithm  1)  9  9 


m 

n 

T 

No.  Solved 

Time 

(seconds) 

Iterations  j 

I  1 

f . .  _  _ ..  .  —  j 

Cuts  j 

Percent  Covers 
Extended 

5 

30 

30 

5 

5.5 

6.0 

17.4 

95.2 

10 

30 

30 

5 

91.8 

8.8 

|  41.0 

94.2 

15 

30 

30 

3 

183.9 

12.6 

68.2 

96.0 

20 

30 

30 

2 

253.8 

29.2 

!  144.6 

93.1 

1.  5  problems  per  class. 

2.  Values  averaged  for  all  5  problems 

3.  Limit  sec  to  5  minutes  CPU  time  or  150  iterations  per  problem. 


Table  4  shows  chat  as  the  number  of  variables  increases  from  30  to 
40  to  50,  the  number  of  problems  that  the  algorithm  is  able  to  solve  within 
3  minutes  and  150  iterations  drops  from  5  to  4.  This  is  of  course  to  be 
expected,  since  the  number  of  variables  Increases  to  the  same  extent  in  the 
linear  0-1  program  as  in  (MLP).  Table  5  shows  a  steady  deterioration  of 
performance  as  the  number  of  constraints  increases.  This  is  due  to  the 
fact  that  the  number  of  inequalities  in  the  linear  equivalent  of  (MLP) 
sharply  rises  with  the  number  of  constraints  of  (MLP),  hence  so  does  the 
number  of  iterations  required  to  generate  a  relevant  subset  of  the  linear 
inequalities. 

In  the  last  two  tables  we  finally  examine  the  performance  of  Algorithm  I 
in  the  heuristic  mode.  When  used  as  a  heuristic,  Algorithm  I  stops  at  the 
first  (approximate)  solution  of  the  linear  0-1  program  (found  by  Pivot  and 
Complement)  that  is  feasible  to  (MLP). 


Table  6.  Algorithm  I  in  the  heuristic  tnode^*^*^ 


m 

n 

T 

I 

No. 

3olved 

j  Iterations 

i 

Time 

(seconds) 

! 

Proximity 

to 

LP  bound 

Proximi 

to 

Integer 

Optimum 

10 

30 

20 

5 

l  4.2 

2.0 

1.77. 

0.127. 

10 

30 

30 

5 

7.4 

f 

7.6 

2.97. 

0.167. 

10 

30 

40 

5 

I 

1  6.8 

1 

4.6 

2.47. 

0.077. 

10 

30 

50 

5 

!  8.6 

10.1 

2.27. 

0.007. 

10 

30 

60 

i 

!  5 

10.0 

15.4 

2.77. 

0.227. 

1.  5  problems  per  class 


2.  Values  averaged  for  all  5  problems. 

3.  Limit  set  to  3  minutes  CPU  time  per  problem. 
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The  linear  programming  solution  to  the  last  linear  0-1  program  (more 
precisely,  the  lowest  value  of  any  LP  solved  during  the  procedure),  rounded 
down  to  the  nearest  integer,  provides  an  upper  bound  for  the  optimum  of 
(MLP),  which  we  call  the  LP  bound.  This  bound  is  guaranteed,  but  in  most 
cases  not  tight.  For  the  problems  of  Table  6  the  integer  optimum  is  also 
known,  so  the  quality  of  the  heuristic  solution  can  be  measured  against  the 
actual  optimum.  For  the  problems  of  Table  7  this  is  not  the  case,  and  the 
only  measure  available  is  the  LP  bound.  On  both  counts,  the  quality  of  the 
solutions  obtained  by  using  Algorithm  I  in  the  heuristic  mode  seems  excellent, 
and  the  computational  effort  is  modest. 

Table  7.  Additional  tests  with  the  heuristic^ 9 ^ 9 ^ 9 


m 

H 

No.  Solved 

Iterations 

Time 

(seconds) 

Proximity 
to  LP 
optimum 

10 

30 

i 

70 

4 

1  29.0 

64.1 

2.47.1 2 3 4 

10 

40 

30 

t 

5 

2.1 

16.9 

i 

2.97. 

10 

50 

30 

5 

8.8  ■ 

19.5 

1.87. 

10 

50 

40 

5 

10.2 

26.5 

1.87. 

10 

50 

50 

5 

i  ii.4 

1 

29.1 

1.57. 

5 

100 

30 

5 

i 

1  8.2 

14.8 

0.77. 

5 

100 

50 

;  5 

\ 

!  15.4 

65.4 

j  0.87. 

5 

150 

30 

5 

6.8 

16.9 

!  0.47. 

1.  5  problems  per  class. 

2.  Values  averaged  for  all  5  problems. 

3.  Limit  set  to  3  minutes  CPU  time  per  problem. 

4.  Average  for  the  4  solved  problems. 


We  conclude  from  this  computational  study  that  Algorithm  I,  based 


on  the  linearization  of  sections  2*3  is  an  efficient  procedure  for  solving 
multilinear  0-1  programs  to  optimality.  In  particular,  problems  having  more 
than  20  terms  per  constraint  have  now  been  opened  up  to  exact  solution.  The 
use  of  the  first  phase  of  the  algorithm  as  a  heuristic  is  also  an  attractive 
option  for  problems  with  many  constraints  and/or  variables,  in  that  high 
quality  solutions  can  be  obtained  at  a  modest  computational  cost. 
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multilinear  0-1  program  is  given,  and  computational  experience  with  the  algorithm 
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